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INTRODUCTION 


Numerical analysis is the study of algorithms to find solutions for problems of 

NOTES continuous mathematics. It helps in obtaining approximate solutions while maintaining 
reasonable bounds on errors. Although numerical analysis has applications in all 
fields of engineering and the physical sciences, yet in the 21st century life sciences 
and both the arts have adopted elements of scientific computations. Ordinary 
differential equations are used for calculating the movement of heavenly bodies, 
i.e., planets, stars and galaxies. Besides, it evaluates optimization occurring in 
portfolio management and also computes stochastic differential equations to solve 
problems related to medicine and biology. Airlines use sophisticated optimization 
algorithms to finalize ticket prices, airplane and crew assignments and fuel needs. 
Insurance companies too use numerical programs for actuarial analysis. The basic 
aim of numerical analysis is to design and analyse techniques to compute approximate 
and accurate solutions to unique problems. 


In numerical analysis, two methods are involved, namely direct and iterative 
methods. Direct methods compute the solution to a problem in a finite number of 
steps whereas iterative methods start from an initial guess to form successive 
approximations that converge to the exact solution only in the limit. Iterative methods 
are more common than direct methods in numerical analysis. The study of errors is 
an important part of numerical analysis. There are different methods to detect and 
fix errors that occur in the solution of any problem. Round-off errors occur because 
it is not possible to represent all real numbers exactly on a machine with finite 
memory. Truncation errors are assigned when an iterative method is terminated or 
a mathematical procedure is approximated and the approximate solution differs 
from the exact solution. 


This book, Numerical Analysis, is divided into four blocks that are further 
divided into fourteen units which will help you understand how to solve 
transcendental and polynomial equations, rate of convergence of iterative methods, 
methods for finding complex roots — polynomial equations, Birge-Vieta method, 
Bairstow's method, Graeffe's root squaring method, system of linear algebraic 
equations and eigenvalue problems, error analysis of direct and iteration methods, 
finding eigenvalues and eigenvectors — Jacobi and power methods, interpolation 
and approximation, Hermite interpolations, piecewise and spline interpolation, 
approximation, least square approximation and best approximations, differentiation 
and integration, numerical differentiation, partial differentiation, ordinary differential 
equations, Euler, backward Euler, Taylor’s method, second order Runge Kutta 
methods, and stability analysis. 


The book follows the Self-Instruction Mode or the SIM format wherein 
each unit begins with an ‘Introduction’ to the topic followed by an outline of the 
‘Objectives’. The content is presented in a simple, organized and comprehensive 
form interspersed with ‘Check Your Progress’ questions and answers for better 
understanding of the topics covered. A list of ‘Key Words’ along with a ‘Summary’ 
and a set of ‘Self Assessment Questions and Exercises’ is provided at the end of 
the each unit for effective recapitulation. Logically arranged topics, relevant solved 


Self-Instructional  €Xamples and illustrations have been included for better understanding of the topics. 
Material 


Transcendental and 


BLOCK - I Polynomial Equations 
POLYNOMIAL EQUATIONS AND 


EIGEN VALUE PROBLEMS 
NOTES 


UNIT 1 TRANSCENDENTAL AND 
POLYNOMIAL EQUATIONS 


Structure 
1.0 Introduction 
1.1 Objectives 
1.2 Transcendental and Polynomial Equations 
1.3 Answers to Check Your Progress Questions 
1.4 Summary 
1.5 Key Words 
1.6 Self Assessment Questions and Exercises 
1.7 Further Readings 


1.0 INTRODUCTION 


In mathematics, a polynomial is an expression consisting of variables (also 
called indeterminate) and coefficients, that involves only the operations 
of addition, subtraction, multiplication, and non-negative integer exponents of 
variables. An example ofa polynomial ofa single indeterminate, x, is x? — 4x +7. 
An example in three variables is x? + 2xyz? — yz +1. 


Polynomials appear in many areas of mathematics and science. For example, 
they are used to form polynomial equations, which encode a wide range of problems, 
from elementary word problems to complicated scientific problems; they are used 
to define polynomial functions, which appear in settings ranging from 
basic chemistry and physics to economics and social science; they are used 
in calculus and numerical analysis to approximate other functions. In advanced 
mathematics, polynomials are used to construct polynomial rings and algebraic 
varieties, central concepts in algebra and algebraic geometry. 


In this unit, you will study about transcendental and polynomial equations, 
and rate of convergence of iterative methods. 


1.4 OBJECTIVES 


After going through this unit, you will be able to: 
e Understand linear integral equations and some basic identities 
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e Reduce initial value problems to Volterra integral equations 


e Know the methods of successive approximation and successive substitution 
to solve Volterra equations of second kind, iterated kernels and Neumann 
series for Volterra equations 


e Express resolvent kernel as a series in A 

e Know Laplace transform method for a difference kernel 

e Findthe solution ofa Volterra equation ofthe first kind 

e Reduce boundary value problems to Fredholm integral equations 


e Know the method of successive approximation and successive substitution 
to solve Fredholm equations of the second kind 


e Know iterated kernels and Neumann series for Fredholm equations 


e Express resolvent kernel as a sum of series and Fredholm resolvent kernel 
as a ratio of two series 


e Know Fredholm equations with separable kernels, approximation ofa kernel 
by a separable kernel and Fredholm alternative 


1.2 TRANSCENDENTAL AND POLYNOMIAL 
EQUATIONS 


In mathematics, an integral equation is an equation in which an unknown function 
appears under an integral sign. 


An integral equation in u(x) is given by, 


n B) 


u(x) — f(x) 4- À | K(x, thu(t)dt (1.1) 


atx} 


where K(x, f) is called the kernel of the integral Equation (1.1) and a(x) 
and B(x) are the limits of integration. It can be easily observed that the unknown 
function u(x) appears under the integral sign. It is to be noted here that both the 
kernel K(x, À and the function f(x) in Equation (1.1) are given functions; and À is 
a constant parameter. We have to determine the unknown function u(x) that will 
satisfy Equation (1.1). 

An integral equation can be classified as a linear or nonlinear integral equation. 
The most frequently used integral equations fall under two major classes, namely 
Volterra and Fredholm integral equations. In this unit we will distinguish following 
integral equations: 

e Volterra integral equations 


e Fredholm integral equations 


Volterra Integral Equations Transcendental and 
Polynomial Equations 


The most standard form of Volterra linear integral equations is ofthe form 
PX 
P(x u(x) = f(x) 4- 4 | K(x, thu(t)dt NOTES 
where the limits of integration are function of x and the unknown function 
u(x) appears linearly under the integral sign. 
If the function (x) = 1, then equation becomes 


"X 
u(x) — f'(x) 4- 4 | K(x, tyu(t)dt 
va 
and this equation is known as the Volterra integral equation of the second 
kind; whereas if @(x) = 0, then the equation becomes 


PX 


f(x) +A | Kix, t)u(t)dt = 0 


va 


which is known as the Volterra equation of the first kind. 
Fredholm Integral Equations 


The most standard form of the Fredholm linear integral equations is given 
by, 


d(x)u(x) = f(x) +A | K(x, t)u(t)dt (1.2) 


J ü 
where the limits of integration a and b are constants and the unknown function 
u(x) appears linearly under the integral sign. If the function @(x) = 1, then Equation 
(1.2) becomes, 
wb 


u(x) = f(x) 4- X l K(x, t)u(t)dt 


Ja 
and this equation is called Fredholm integral equation of second kind; whereas 
if ọ(x) = 0, then Equation (1.2) gives, 


F 


fix) 43- X | 
Ja 


which is called Fredholm integral equation of the first kind. 


K(x. t)u(t)dt = 0 


Initial Value Problems Reduced to Volterra Integral Equations 


Consider the integral equation, 


y(t)— | f (tdt 
JU 
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Transcendental and The Laplace transform of f(1) is defined as 
Polynomial Equations 


Lift = i e "f(t)dt — F(s). 


NOTES Using this definition the above integral equation can be transformed to 
2i n l * í n 
[wt Lf fit) 
^ 
In a similar manner if ( ) = A » f (t)dtdt then 
^r S l ^f , 
DIXI m = TO. 
g^ 
This is inverted by convolution theorem to give 
v(t)y— | (I— t) (addr. 
ü 
If wWo= | | et | f(t)dtdt..- dt 
JO JO J0 
n-lold integrals 
Then C} y(1)] = kA LH f(t )} Using the convolution theorem, we get 
the Laplace inverse as | 
; wq T = 
y(t)= — A (1 t. 
9 (n— I) 
Thus the n-fold integrals can be expressed as a single integral as, 
/ vf af af n T y! ; 
| | E f (Odtdt ---dt = —— dt. 
0 JO JO o (n— l1)! 
n-fold integrals 
Self-Instructional - 


4 Material 


Method of Successive Approximation to Solve Volterra Integral 
Equations of Second Kind 


Volterra integral equation ofthe second kind is ofthe form, 


"X 
u(x) — f(x) 4- 4 | K(x, t)u(t)dt 
JD 
where K(x, t) is the kernel of the integral equation, f (x) a continuous function 
of x and X a parameter. Here, f(x) and K(x, f) are the given functions but u(x) is 
an unknown function that needs to be determined. The limits of integral for the 
Volterra integral equations are functions of x. 


In this method of approximation, we replace the unknown function u(x) 
under the integral sign of the Volterra equation by any selective real valued continuous 
function u (x), called the zeroth approximation. This substitution will give the first 
approximation u (x) by 


"X 
uj(x) — f(x) - A | K(x, t)uo(t)dt 


40 
It is obvious that u (x) is continuous iff (x), K(x, t) and u (x) are continuous. 


The second approximation w,(x) can be obtained similarly by replacing u (x) in 
the above equation by u (x) obtained above. And we find, 


- 
uxx) — fix) 4- X | K(x, thu, (tdt 


JU 
Proceeding ina similar way, we obtain an infinite sequence of functions 


ug(x), u(x), uo(x). . .., up(x).... 


that satisfies the recurrence relation 
^X 
us(x) — f(x) +A | K(x, t)u, (Hdt 
JU 
for n = 1, 2,3,... and u(x) is equivalent to any selected real valued 
function. The most commonly selected function for u, (x) are 0, 1 and x. Thus, at 
the limit, the solution u(x) ofthe Volterra equation is obtained as, 


u(x) — lim ugí(x), 
n—> oc 


so that the resulting solution u(x) is independent of the choice of the zeroth 
approximation u(x). This process of approximation is extremely simple. However, 
if we follow the Picard’s successive approximation method, we need to set u (x) 
=f (x), and determine u(x) and other successive approximation as follows: 
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NOTES 
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X 
uj(x) 2 fix)2- A | Ki. tf (pdt 
0 


x 
u»(x) = f(x)+ af K(x, tju, (G)dt 
NOTES ^ 


x 
ug 1x) = f(x) + i | K(x, t)ug 2(tdt 
0 


© 
Un(x) = f(x) + i | K(x, t)un_\ (Oat 
0 


The last equation is the recurrence relation. Consider 


x t 
u(x) — u(x) = af Kix DIS) + a | K(t, r)f(t)dtdt 
0 0 
x 
—A] Kix, tf (Ðdt 
0 


x t 
=}? ke. | Kit, rf (t)dtdt 
0 


0 


a F 
= A^ wx) 
Where, 


x I 
plx) = Í K(x,t)dt | K(t,r)f(t)dt 
0 Jo 


Thus, it can be easily observed that, 


n 
ug(x) = . AP yrg(x) 


m=) 


if wx) (x), and further that 


x 
Vm(x) = | K(x, tyr (dt, 
0 


where m=1, 2,3,... and hence, 


Vie) fp K(x, of (Ode. 
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Transcendental and 


The repeated integrals in “2‘*) may be considered as a double integral Ba EUEN 


over the triangular region; thus interchanging the order of integration, we obtain 


NOTES 
x x 
y(x) = | f(r)dt l Kix, t)K(t, r)dt 
JO JT 
Xx 
= | K»(x, x yf (t)dt 
Jo 
Where, 
Ko(x,t)= f° K(x, )K(t, v)dt. 
Similarly, 
i 
mix) = f Km(x,t)f()dt, m= 1,2,3,... 
#0 
Where the iterative kernels, K(x, t) = K(x. t), Ka(x, t). Ka(x, t)... are 
defined by the recurrence formula given by, 
" 
Kmi x,t) = f K(x, t)ka Ddr: m= 1,2,;3,... 
Jf 
Thus, the solution for u (x) can be written as, 
n 
tinlx) = f(x) + 5 as Vrmix) 
m= 
Resolvent Kernel as a Series in L 
It is also possible that we should be led to the solution of Volterra equation by 
means ofthe sum if it exists, of the infinite series defined by u (x). Thus, we have 
using y. (x) 
n eX 
uj(x) = f(x) + 3 a” | K(x, t) f (dr 
m=] J0 
x n 
= f(x) G x >: A KDE: o ren 
#0 m=] 
hence it is also possible that the solution of Volterra equation will be given 
by as n—2oe 
Self-Instructional 


Material 


Transcendental and 
Polynomial Equations lim ug(x) — u(x) 
nox 


n 


aX 
=/0)+ | X A" K(x.) f(r)dr 
NOTES 0 | | 


m=l 


"X 
— f(x)4- A | H(x, 1; Af (1)dt 


JD 


Where, 


Hitz, ex = X, AP Kx, t) 


m=1 
is known as the resolvent kernel. 
Laplace Transform Method for A Difference Kernel 


Volterra integral equation of convolution type such as 


^ 
u(x) — f(x) 4- X | K(x — t)utt)dt 
JU 


where the kernel K(x—1) is of convolution type, can very easily be solved 
using the Laplace transform method. To begin the solution process, we first define 
the Laplace transform of u(x) 


* «] 
L{u(x)} = | e * u(x)dx. 


vO 


Using the Laplace transform ofthe convolution integral, we have 


X 


c| .K&- pour] = £L{K(x)}L{u(x)} 
J0 
Thus, taking the Laplace transform of Volterra integral equations of 
convolution type, we obtain 
C|u(x)) 2 Lif(x)} + ALK (x) £[utx)] 
and the solution for L {u(x)} is given by 
z Ef (x) 
L{u(x)} = —————. 
ue) = TALKO) 


By inverting this transform, we obtain 


x 
y= W(x — tf o 
u(x) = Í Vx — A Ddt Sere L! | viven] — vx) 


Self-Instructional 
8 Material 


Example 1: Solve the following Volterra integral equation ofthe second kind of 
the convolution type using (a) the Laplace transform method and (b) successive 
approximation method 


X 
u(x) — f(x) +A f e* u(t )dt 
0 


| 


Solution: (a) Taking the Laplace transforms, we obtain 


C(u(x)) = £(f(x)) + X£(e) Ll u(x)}, 


and solving for L {u(x)} yields 


| Lif (x)}. 


L(u(x)) = 1+ : 
s—1—A 


The Laplace inverse of the above can be written immediately as 
aX ERA 
u(x) = | {d(x — £) + Ae 2990 f (tdt 
JU 


; 
=fr f eof (pt 


JU 


where 6(x) is the Dirac delta. 

(b) Solution by successive approximation 

Let us assume that the zeroth approximation is, 
ux) = 0 

Then the first approximation can be obtained as 


uix) =f (x) 


Hence, the second approximation is given by 


^X 


u(x) = f (x) +A | ef (t)dt 


0 


Proceeding in similar manner, the third approximation can be obtained as 
"X 
ustx) = f(x) +A | e u(tdt 
J0 

a pl 
—f(x)4A] e" lro +2 | ef (r «| dt 
) J0 
€ 


= f(x)+A 


0 
1 
PX ) 2 x I 

| e ifii +92 | [e *{(t)dtdt 

0 0 J0 

PX ^X 


=fix)+2 | ef (t)dt +}? | (x — t)e* f (t)dt 


{ J0 
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Transcendental and In the double integration the order of integration is changed to obtain the 
Polynomial Equations "n : : 
final result. In a similar manner, the fourth approximation u (x) can be at once 
written as 


Y 


x J 
NOTES ua(x) = f(x) +A Í eros | (x — t)e* 'f (t)dt 
0 +0 


"S 2 2 
UO —ETIE 2. 
— p | =a E f (Dat. 
0 
Now, as n — co 


u(x) = lim ug(x) 
n—-oo 


^X | s : 1 
= f(x) +h i gt ( l +(x —f)+ aya x —ty + roa 
0 k PA 


Š 
= f(x)4- X f eF—) ghx-Df(ngr 
Jo 
x * - 
= f(x)+Aa el 06 (fdt 
“0 
Here, the resolvent kernel is H(x, t; A) = eC"), 


Method of Successive Substitution to Solve Volterra Integral 
Equations of Second Kind 


In this method, we substitute successively for u(x) its value as given by Volterra 
integral equation of the second kind. We find that 


X i 
ux) =f f Ke. bro». f Ki twn dn | d 
0 /0 


í 


X x 
= f(x)+2 Í Kix, ty (t)dt + A? f K(x,t) | Kit, t u(t) )dtydt 
0 J0 J0 


X x I 
=f) f Kos nnt +22 | Kon f K(t, ty f(t dtydt 
0 /0 J0 


t I1 


x 
Rud sae [ Kx. t) K(t,t)--- K(tg. 1. tn)u(tn )dty -- - dtydt 
0 0 


JU 
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is the remainder after n terms. Transcendental and 
Polynomial Equations 


Now, 


lim, >00 Rus 120 


Accordingly, the general series for u(x) can be written as NOTES 


x 
u(x) = f(x) +A | K(x, ty Godt 
JO 
x x I 
+à“ f Í K(x, OAK (t,t) M Cri edt dt 
MAU 0 
x pl pt 


t. ph 
+23 | | K(x, DK (t,t) K(h, bf (t3)dtadt, dt 
0 0 JO 


Example 2: Solve the integral “&) = 1 + fo tt. 


Solution: By the method of successive substitution, we get 


x X opx X px px. 
u(x) = | | dt + | f dt“ +f f / dt^ 3. 
Jo Jo Jo 0 Jo Jo 


- NEC. ae 
=lex4 5454" 


3! 


=€. 


Iterated Kernels and Neumann Series for Volterra Equations 


The integral, 


ula) = fe) +A f TG 63/(d€ where Pfæ,g;A) is the 


resolvent kernel is the solution ofthe Volterra integral equation ofthe second kind, 
given by 


ule) = f) +A f * K(x, €)u(€)dé 


When both K (z, £) and f(x) are continuous then the resolvent kernel can 
be constructed in terms ofthe Neumann series 


co 
T'(z,6; 4) = 9 A" Ks iz, £) 
n=0 
Self-Instructional 
Material 11 


Transcendental and 
Polynomial Equations 


Where K 4.1 (z, £) is the iterated kernel which is evaluated as, 


Kenia = f K (z, y) Ka (y, £)dy 
NOTES £ 


and K, (x,y) = K(z,y)- 


For showing this, assume the following infinite series form for the solution 


u(x), 
u(z) = uo(z) + Au, (z) + Mus(z) dioe 


Substituting this in the Volterra integral equation ofthe second kind and 
assuming good convergence which allows the exchange of summation with the 
integration operation, we get 


uo(z) + Auj(z) + Mug(z) + 
= fosa * K(z, £)uo(£)d£ +X? f Kee (0d + 


Equating coefficients of À on both sides, we have 


uo(z) = f(z) 
ui(z) = / K (z, £)us(£)d£ 


wii | K(x, €)ui (€)dé 


wx) = f * K(2,€)tun1(€)d€. 


By successive substitution, we get 


ti (2) = f  K(z,O)f(£)dt 


And 


T [4 
u(x) = " K (z,£) f K (€, t) f (t)dtdg 
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Transcendental and 
Polynomial Equations 


wt) =f so |f keke te] ae 


u2(z) =| f(E) Kalz, t)dt NOTES 
= [ «oro 


Similarly, 
Ka(z,t) = Í " K(z,)K(E, tdt 


= [ korea 
So we can now write, 
Kis) = f7 K(E,E)KalE Dd, as the general tem ofthe 
iterated kernel and 
weno) = f Kanila DAOA. 


Therefore, 


ws) = f(a) +A f ” Ki(z Of (dt +9? / * Kala, £f (Edk 
ec» [ Kn EAEE +> 


= f(z)-* Af [Ki(z,£) + AKa(z, £) +- 
+A" Ky(z E) ++ f(£)d£ 


= f(a) +A ji "TSA" Ka 8) f(&)dt 
pA n=0 
= f(z) +) f P(x, €; X) (£)d 
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Transcendental and Solution of a Volterra Integral Equation of the First Kind 
Polynomial Equations 


The first kind Volterra equation is usually written as, 


^X 


NOTES | K(x, t)u(t)dt = f (x) 
J0 


T =f" (x), X =K;(x, t), and 4X = K, (x. ryexist and are 


continuous, then the solution ofthis equation is found by reducing it to its second 
kind and then proceeding with the methods discussed above. 


If the derivatives 


Differentiating the above Volterra equation and applying Leibnitz rule, we 
get 


PX 
Kexu) + | kx(x, t)u(t)dt = f(x) 
0 


If K(x, x) z O0 then 


"X 
K(x, x)u(x) + .* kx(x, t)u(t)dt = f'(x) 


JU 


f'(x) 
<ul t = 


u(x)+ 
J0 — K(x.x 


The second way to obtain the second kind Volterra integral equation from 
the first kind is by using integration by parts, if we set 


PX 


| u(t)dt = x) 
J0 


Or | u(E)dE = P(t) 
Jo 


By integrating by parts, we have 


Y 


I "X / pl 
[Kann f were] — | K(x, t) (| «yd dt — f(x) 
0 t-0 J0 0 


X 


which reduces to [K (x, t yx io — Kix, t ot odt = f(x) 
0 
Giving 
PX 
K(x, x plx) — K(x, 00) — | Ki(x, tt t)dt = f(x) 
0 
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Q(0) = 0, and dividing out by K(x, x) we have Transcendental and 


Polynomial Equations 
TE | f(x) iy A Ki(x, 
qux) = = = 
; K(x,x) Jo LK: 
X 


t) 

) | e tyat 

' NOTES 

= F(x) + G(x, t)o(t)dt 
/0 


where F(x) = T and G(x, 1r) — EE. 


In this method the function f(x) is not required to be differentiable. But u(x) 
must finally be calculated by differentiating the function @(x) given by the formula 


f(x) lag f(t) 
d(x) = { — + A(x, t: 1) 4 = it 
di rl I i Cii 


: : KG) i 
where H(x, t : 1) is the resolvent kernel corresponding to IT . To do this 


f(x) must be differentiable. 


Boundary Value Problems Reduced to Fredholm Integral Equations 


A boundary value problem can be converted to an equivalent Fredholm integral 

equation. But this method is complicated and so is rarely used. This method is 

demonstrated with the help of following illustration: 
Consider the differential equation 

v(x) + Py Olx) / (X). with boundary 


conditions 
tSn: WU 
yzebs De. 


Where œ and p are given constants. Make the transformation, 


re 


y (x) u(x) 
Integrating both sides from a to x, we get 
v (x)= v'(ta)4- ult dt 
Integrating with respect to x from a to x and applying the given boundary 


condition at x — a, we get 
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Transcendental and 
Polynomial Equations 


v(x)2 v(a) + (x — ay'(aH- | | ul tdt di 


SU IU 


NOTES = «4 (x— ov) +f | u(t dtdt 
And using the boundary condition at x = b gives, 
Wh) = B= a+ (b— awla) | | utt ydtdt, 
And the unknown constant 1) '( (4 Wis determined as 
i 7 = Q | aft ah i 
y(ad)z wann — | | ul t)dtdt , 
b —— u b EE. vu vd 

Hence the solution can be rewritten as, 

J| Pt WP A M 
yx) = a+ (x—a) — u(t didit 

b — a b — C Ja Ja 
+ | | ut tydtdt 
Therefore, 
u(x)y— f (x)— P(x) pw + | wd | 
= Ost le a)v (a) { | | ut t)ydt di | 
wheret!(A) = v” (x) andso (x) canbe determined. It is a complicated 
procedure to determine the solution of a Boundary Value Problem (BVP) by 
equivalent Fredholm equation. 
If a=Oand b= 1,i.e.,0 <x < 1, then 
Self-Instructional 
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Transcendental and 
Polynomial Equations 


y(x) =a + xy'(0) + j uoa 


"x NOTES 
= a+ xv (a) «| (x — iy(i )dt 


And hence the unknown constant V i (0) can be determined as 


v(0) - (p —()— | (1 — fut )dt 
Uu 
z(B-— a - (1— t)u( )dt — | (1 — tuldi 
JU JX 


Thus, 
u(x)— f(x)— P(x) |o + | ut t)dt | 
(J 


— Ost xv (0) + | (X - utod} 
Jl) 


al 
u(x)y— f(x) — (8. — c WAPAA xO(x) — oOGO4- | K(x, t yut dt 
ü 


Where the kernel Å (x, !) is given by, 


(Fx) + (rQix)y(1— x) O< t= x 
(Pix)+ xO(x)(1— tf) x <r <1 


K(x.t)— 


It can be easily verified that K (3,7) — A (1, X) confirming that the 


kernel issymmetric. The Fredholm integral equation isgiven by u(x). 
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Transcendental and Example 3: Consider the boundary value problem, 
Polynomial Equations 


v'(x)y2 tix viv), O< x < 1 


NOTES . 
yX0)2yo, »xl)-2 vy 
Solution: Integrating the equation with respect to x from 0 to x two times yields 
vx) (0) + xv(0) 4 | | f(t.va))didt 
a J0 
Va — xy (0) + ix — i)f(i,v(i))dt 
JO 
To determine the unknown constant 1' {0}, weuse the condition at x= l, 
i.e., y(1)=y,. Hence, 
T 
M l p Yı = Yo + y'(0) — | ( l — ty (t, y(t pdt, 
JU 
And 
l 
y (0) 2 (yı — yo) — | (1 — f(t, (ade. 
Jo 
Therefore, 
al 
yax) = yo + x01 — vo) — K(x, t)f(t.yt))dt, O<x<1 
0 
Where the kernel is given by, 
= O<t<—x 
K(x.t)= t(l — t) Etzx 
x(1—f) x<rt<l. 

If we specialize our problem with simple linear BVP y"(x) 7 —y(x), 0 <x 
< 1 with the boundary conditions y(0) = y, y(1) =y, then y(x) reduces to the 
second kind Fredholm integral equation, 

jl 
yx) = F(x) 4- 4 | K(x, pldt, O<x<1 
J0 

where F(x) = y, + x(y, — y,). It can be easily verified that K(x, £) = 

K(t, x) confirming that the kernel is symmetric. 
Self-Instructional 


18 Material 


Method of Successive Approximation to Solve Fredholm Equations of Transcendental and 
. Polynomial Equations 
Second Kind 


The successive approximation method, which was successfully applied to Volterra 
integral equations ofthe second kind, can also be applied to the basic Fredholm NOTES 
integral equations ofthe second kind: 


^h 


u(x) — f(x) +A | A(x, t ut t)dt 
va 
We set u (œ) =f(x). Note that the zeroth approximation can be any selected 
real valued function u,(x),a € x € b. 
Accordingly, the first approximation u (x) ofthe solution of u(x) is defined 
by 
h 


uj(x) 2 f (x) +a f K(x, thug(tjdt 


Jā 
The second approximation u,(x) ofthe solution u(x) can be obtained by 
replacing u (x) by the previously obtained u (x). Hence we find 
^b 
ux(x) = f(x) +4 | K(x, thu (Odt. 
Jo 
This process can be continued in the same manner to obtain the nth 
approximation. In other words, the various approximations can be put in a recursive 
scheme given by 


uox) = any selective real valued function 
b 
uj(x) = f(x) + | K(x,t)ug 41dt, n21. 
Ja 


Even though we can select any real valued function for the zeroth 
approximation u(x), the most commonly selected functions for u (x) are u,(x) = 
0, 1 or x. With the selection of u (x) = 0, the first approximation u(x) = 
f(x). The final solution u(x) is obtained by 


u(x) = lim ug(x) 
n—.oo 


so that the resulting solution u(x) is independent ofthe choice of u (x). This 
is known as Picard's method. The Neumann series is obtained if we set u,(x) =f 
(x) such that 


Pb 
uj (x) — f(x) +A | K(x, t)ug(t)dt 
va 
b 
—f(x)4A / K(x, Of (pdt 
va 
= f(x) + AWi(x) 
Self-Instructional 
Material 19 
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Polynomial Equations à 


b 
W(x) = Í Kix, t (pdt 
va 


NOTES T : 
The second approximation u,(x) can be obtained as, 


"b 
u»(x) = f(x) +A | K(x, thu, (ddt 


Ja 
-ro». f K(x, t) Uf Gt) + Av (10) dt 
a 


= f(x) + Avy (x) + A W(x) 
Where, 


h 
Vo(x) = | K(x, thy (t)dt 
“a 
The final solution u(x) known as Neumann series can be obtained as, 
u(x) = f(x) + Aw) (x) + A wa(x) + A gx) 4- --- 
oc 
= fx) T: p» Pla Walx ). 

n=! 


Where, 


h 


W(X) = f K(x, Wn- jdt n > l 


J 


Example 4: Solve the Fredholm integral equation 


l 
u(x) = 1 + i xu(t)dt 


J0 


by using the successive approximation method. 


Solution: Let us consider the zeroth approximation is z (x) = 1, and then the first 
approximation can be computed as 


ma = 1+ | xuo(t)dt 
J0 


l 
= 14 Í xdt 
JU 


—1-rx 
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, Polynomial Equations 


mix) = 1+ | xuy(tydt 
J0 


II 


l 
i+ | x(1 + tdt NOTES 


#0 


l 
l+x(1+5) 


l » P 

St 
u(x) = iex f (1+>)a 
J0 - 


2 4 
Thus, 
| l | l 
ug(x) = l +x zz 
And 
u(x) = lim u(x) 
n—2oc 
" | 
= 1+ lim x —— 
n> 00 >. 2k 
k—0 
=1+x(1-5) 
—1-F2x is the solution. 


Method of Successive Substitutions to Solve Fredholm Equations of 
Second Kind 


This method is almost analogous to the successive approximation method except 
that it concerns with the solution ofthe integral equation in a series form through 
evaluating single and multiple integrals. 


b 
u(x) — f(x) 4- À f K(x, t)u( t)dt 
“a 
K(x, t) #0, is real and continuous in the rectangle R, for which a £x € b 


anda €t b; f(x) z 01s real and continuous in the interval Z, for which a € x € 
b; and À, a constant parameter. 
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Transcendental and Substituting the value of u(f) in this equation, we get 
Polynomial Equations 


b b b 
u(x) — f(x) 4- i | K(x, Of (dt + | Kix, Df K(t, ty ultdtidt 
a a a 


NOTES 
or 
b 
u(x) = f(x) +A f K(x, t)f (dt 
a 
, [^ b 
4-A* Kx, t) | K(t, ty f Cdt dt 
“a va 
b b b 
A Í K(x, nf K(t.ti) i K(ty, t3 ul fy dtodt dt 
a a JI 
Hence, 
b 
u(x) = f(x) 4- X Í Kix, ty (pdt 
a 
. fb b 
+A° Í K(x, o [ K(t, ty f (ti )dti dt 
ü a 
b b b 
FAS J K(x, nf K(t,t) | Kí(ty, t2)f (t2)dtodtydt 
a a “a 
— eee 
The unknown function u(x) is replaced by the known function f(x). 
Example 5: Use the successive substitutions to solve the Fredholm integral equation 
| 2/2 
u(x) = cosx + — Í sin xu(t)dt. 
á J0 
Solution: Here, A = 12, f(x) = cos x, and K(x, t) = sin x 
l x/2 ; l zj2 x/2 f 
u(x) = cosx + — Í sinx cos fdf + — f sinx f sin / cos fı dti dt 
2 Jo 4 Jo 0 
l z/2 z/2 z/2 
+— f sinx f sin f sin fj cos t2dtsdti dt +--+- 
8 JÜ ü 0 
= cosx + ! sinx + i sin x + l sinx + 
Ludo a a cue 
= cosx + sinx 
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Iterated Kernels and Neumann Series for Fredholm Equations Transcendental and 
Polynomial Equations 
The Liouville-Neumann series is defined as, 


@ (x) = F A On (x) NOTES 


n=0 


It is a unique continuous solution of a Fredholm integral equation of the 
second kind, defined as 


b 
f(t) =0(t) - Af K(t,8)0(s) ds 


Ifthe nth iterated kernel is defined as 
Kn (2, z) = WE [x (z.31) K (yi. y2) >=> 


K (951,2) dy; dy eis dy,—1 


Then, 


0.) = |K, (x, z) f (z) dz 
And the resolvent kernel is given by 
a a] 
K (z,z; A) = X Kayı (7,2). 
n=0 
Resolvent Kernel as a Sum Of Series 


Let the Fredholm equation ofthe second kind be, 


b 
u(z) = A(z) + / K (z, y)u(y)dy. 


Where the range ofthe separable kernel 
n 
K(z,y) = V ^ filz)gi(y)- 
i=l 


which consists of arbitrary linear combinations of the functions fis given by, 


b n 
f Ketits = 3: foa. 
- i=1 
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Transcendental and Therefore 
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eee u(x) = h(x) + 2 f;(z)u;. 


To find u, define, 


b 
ge f gi(z)h(z)dz 


Consider the algebraic problem Mu = h, .Ifwe replace A by a kernel 
cK instead ofthe separable K then the equation becomes, 
M-I-cK 
where, / is the identity matrix. Let D(c) be the determinant of the matrix M 
then 
D(c) = det(I — cK) 


If determinant D(c) is not zero then the matrix M has an inverse, 
M^! =C'(c)/D(c) = R(c) 


Then the solution of the algebraic equation becomes u = M^'hor u = Rh. 


Now by substituting these values ofu, in the Fredholm integral equation and 
then expressing A. in terms of h(x), we get 


b 
u(z) = h(z) + f cR(z, y; c)h(y)dy, 


Where, R(z, y; c) = $ ^ Y ^ Ru(c)fi(z)g;() is called the resolvent kernel. 
J 


Fredholm Resolvent Kernel as a Ratio of Two Series 


If K(x, È) is a continuous kernel, not necessarily real then the resolvent kernel 
T(x, £; A) can be expressed as the ratio of two infinite series of powers of A 
such that both of these series converge for all values of A. 


Expressing the resolvent kernel as a ratio, 


D(x, £; 2) 


r(x, €; 4) = AG) 


Self-Instructional 
24 Material 
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Polynomial Equations 


D(x, E; 4) = K(x, E) + AD,(x, E) + 42D4(x, E) +++: 


And A(A)=1+AC, 2€, +, NOTES 


Here the coefficients C, and the function D i, È} can be determined by, 


C,=- J K(x, x) dx, D,(x, £) = C,K(x, £) + J “K(x, E)K(5 È) d&,; 


b 
2C, 2— f " Dx, x)dx, D,(x, £) = C,K(x, £) + f K(x, &) D(5, €) d&; 


IIl] ls 5 5s s i 25wW 2 BI III 


b b 
ac,— -[ D, (x, x) dx, D (x, £) 2 C; K(x, £) +Í K(x, £) D, (5, £) df,- 
The solution ofthe equation given by, 


b 
y(x) = F(x) + af K(x, £)y(£) d£ 


now becomes 


b 
Í D(x, E; A)F(E) d£ 


y(x) = F(x) + A= A 


This method is preferable only when the kernel is separable. 
Fredholm's Equations with Separable Kernels 


This section deals with the study ofthe homogeneous Fredholm integral equation 
with separable kernel given by, 


u(x) =A | K(x, tu(t)dt 
J0 


This equation is obtained from the second kind Fredholm equation 


D 
u(x) — f(x) 4- A | K(x, thu(t)dt, 
va 
Setting f(x) = 0, it is easily seen that u(x) = 0 is a solution which is known as 
the trivial solution. The homogeneous Fredholm integral equation with separable 
kernel may have nontrivial solutions. We shall use the direct computational method 
to obtain the solution in this case. Without loss of generality, we assume that 
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K(x, t) = gix)htt) 


So that, 
NOTES 


.b 


u(x) = Agíx) | h(t )u(t de 
Ja 


For 


a= | h(t)yutt)dt 
Ja 


u(x) = Aagíx) 


We note that & = 0 gives the trivial solution u(x) =0. However, to determine 
the nontrivial solution, we need to determine the value of the parameter A by 
considering Qt z 0. Therefore, 


ah 


Qœ = Aa | A(t)g(t)dt 
va 


Or 


ah 


122A | A(t)e(t)dt 


which gives a numerical value for A #0 by evaluating the definite integral. 


Check Your Progress 


What is an integral equation? 
2. Write the standard form of the Volterra equation. 


3. What is first step in the method of successive approximation to solve 
Volterra equations? 


4. Write the Volterra integral equation of convolution type. 


What are the two methods to reduce a Volterra integral equation of the 
first kind to a second kind? 


6. Express the resolvent kernel as a ratio of two series. 


1.5 ANSWERS TO CHECK YOUR PROGRESS 
QUESTIONS 


1. An integral equation is an equation in which an unknown function appears 


under an integral sign. 
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2. The most standard form of Volterra linear integral equations is ofthe form Transcendental and 
Polynomial Equations 


a 
A(x )u(x) = f(x) 4- X | K(x, tu(t)dt 


“a 


3. Insuccessive method of approximation, we first replace the unknown function NOTES 


u(x) under the integral sign of the Volterra equation by any selective real 
valued continuous function u(x). 


4. Volterra integral equation of convolution type is 
" 
u(x) — f (x) 4- 4 f K(x — t)u(t)dt 
JÜ 


where the kernel K(x — f) is of convolution type. 


5. Thetwo methods to reduce a Volterra integral equation ofthe first kind to a 
second kind are differentiating the Volterra equation and applying Leibnitz 
rule, and by using integration by parts. 


6. Expressing the resolvent kernel as a ratio, 


D(x, £; 4) 


I(x, €;4) = AG) 


where, D(x, Ẹ; 4) = K(x, £) + AD,(x, E) + D(x, E) +++ and 
A(a) = 1+ 4C, + 2C, 4-777, 


SUMMARY 


An integral equation in u(x) is given by, 


Bx) 
u(x) = f(x) 4- À f K(x, t)u(t)dt 


Jot X) 
where K(x, t) is called the kernel of the integral equation, and ox) and 
B(x) are the limits of integration. 


e The most frequently used integral equations fall under two major classes, 
namely Volterra and Fredholm integral equations. 


e [n Volterra equation one of the limits of integration is variable while in 
Fredholm equation both the limits are constant. 


Self-Instructional 
Material 27 


Transcendental and 


Polynomial Equations 1.5 KEY WORDS 


* [ntegral equation: Itis an equation in which an unknown function appears 
NOTES under an integral sign. 


1.6 SELF ASSESSMENT QUESTIONS AND 
EXERCISES 


Short-Answer Questions 


1. Write the two kinds of Volterra integral equations. 

2. What is the basic difference between Volterra and Fredholm equations? 

3. List the methods used to solve Fredholm and Volterra integral equations of 
the second kind. 

4. How can you find the solution of the Volterra integral equation of the first 
kind? 

5. Define iterated kernel for Fredholm and Volterra integral equations. 

Long-Answer Questions 


1. Reduce the following initial value problem to an equivalent Volterra equation: 


d*y dy 


— T — 
dx* — dx? 


=2e, y(0)22,y(0)22,y"(0) = 1,y"(0) = 1. 


2. Solvethe following Volterra integral equations using methods of successive 
approximation with five approximations with u (x) — 0: 


ex 


(a) u(x) = 2x42 —x 4+ | u(t)dt 
I 


X 
(b) u(x)-—-1 -f u(t)dt 
0 


prs 
(c) u(x)21-x-— | (x — f)u(t)dt 
JU 
x 
(d) u(x)— xcosx + Í tu(t)dt. 
#0 


3. Find the solution of the following Volterra integral equations of the first kind: 


x 
(a) xe ^ = | el u(t)dt 


JU 
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X Transcendental and 


(b) tanx — In(cosx) — Í (1 4- x — tu(t)dt, x « 2/2. Polynomial Equations 
0 


"X 


JD 


PX 
2coshx —sinhx — (2— x) = (2 — x + tu(t)dt 
(d) 


0 


4. Reduce the following initial value problem into an equivalent Fredholm 
equation: 


y +2xyy=10<x<1, »(0)=0,~(1)=0 


5. Solve the following linear Fredholm integral equations: 


(a) ux)— sec? x 4- A K u(t)dt. 

(b) u(x)= = + 4 fo xtu(t)dt. 

(c) u(x)— cosx - fj xtu(t)dt. 

(d) “(x)= sec? xtanx — À ha u(t)dt. 


am d . 
(e) u(x)— e* +2 Jo 2e*el u(t)dt. 
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UNIT2 METHODS FOR FINDING 
COMPLEX ROOTS AND 
POLYNOMIAL EQUATIONS 
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2.4 Answers to Check Your Progress Questions 
2.5 Summary 
2.6 Key Words 
2.7 Self Assessment Questions and Exercises 
2.8 Further Readings 


2.0 INTRODUCTION 


In mathematics and computing, a root-finding algorithm is an algorithm for 
finding zeroes, also called roots, of continuous functions. A zero ofa function f, 
from the real numbers to real numbers or from the complex numbers to the complex 
numbers, is a number x such that f(x) = 0. As, generally, the zeroes ofa function 
cannot be computed exactly nor expressed in closed form, root-finding algorithms 
provide approximations to zeroes, expressed either as floating point numbers or 
as small isolating intervals, or disks for complex roots (an interval or disk output 
being equivalent to an approximate output together with an error bound). 


In this unit, you will study about the methods for finding complex roots and 
polynomial equations. 


2. OBJECTIVES 


After going through this unit, you will be able to: 
e Explain the various methods for finding complex roots 


e Analysethe polynomial equations 


2.2 METHODS FOR FINDING COMPLEX ROOTS 


In this section, we consider numerical methods for computing the roots of an 
equation ofthe form, 


fœ)=0 Q.1) 


Where f(x) is a reasonably well-behaved function ofa real variable x. The function Methods for Finding 
Complex Roots and 


may be in algebraic form or polynomial form given by, Fono Fona ons 
f) s a,x" +a, x" 1 +... +a x+ ag (2.2) 
It may also be an expression containing transcendental functions such as cos NOTES 


x, sin x, e", etc. First, we would discuss methods to find the isolated real roots of 
a single equation. Later, we would discuss methods to find the isolated roots ofa 
system of equations, particularly of two real variables x and y, given by, 


f605y)70,g605y)-0 (2.3) 

A root of an equation is usually computed in two stages. First, we find the 
location ofa root in the form of a crude approximation of the root. Next we use 
an iterative technique for computing a better value of the root to a desired accuracy 


in successive approximations/computations. This is done by using an iterative 
function. 


Methods for Finding Location of Real Roots 


The location or crude approximation ofa real root is determined by the use of any 
one of the following methods, (1) graphical and (ii) tabulation. 


Graphical Method: In the graphical method, we draw the graph of the function 
y=f(x), for a certain range of values of x. The abscissae of the points where the 
graph intersects the x-axis are crude approximations for the roots of the Equation 
(2.1). For example, consider the equation, 
f@=x2+2x-1=0 

From the graph of the function y = f(x), shown in Figure 2.1 we find that it 
cuts the x-axis between 0 and 1. We may take any point in [0, 1] as the crude 
approximation for one root. Thus, we may take 0.5 as the location of a root. The 
other root lies between — 2 and — 3. We can take — 2.5 as the crude approximation 
of the other root. 


Fig. 2.1 Graph of y = x*42yz] 


In some cases, where it is complicated to draw the graph of y =f (x), we may 
rewrite the equation f (x) = 0, as f(x) = f(x), where the graphs of y =f, (x) and 


y=f(x) are standard curves. Then we find the x-coordinate(s) of the point(s) of ^ seiy-instructional 
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intersection ofthe curves y =f (x), and y=f,(x), which is the crude approximations 
Complex Roots and 


Polynomial Equations ofthe root (s). 
For example, consider the equation, 
NOTES x'-152x-13.2-0 
This can berewritten as, 


x? 2152x413 


Where it is easy to draw the graphs of y ^x? and y= 15.2 x + 13.2. Then, the 
abscissa ofthe point(s) of intersection can be taken as the crude approximation(s) 
ofthe root(s). 


Fig. 2.2 Graph of y = x? and y = 15.2x + 13.2 


Example 1: Find the location ofthe root ofthe equation xlog,, x =1. 


Solution: The equation can be rewritten as log,, x = ig 
X 


Now the curves y = log, x, and y = = can be easily drawn and are shown in 
X 


Figure 2.3. 


y = logi, x 


1 
Fig. 2.3 Graph of y=— and y «log x 
x 


The point of intersection of the curves has its x-coordinates value 2.5 
approximately. Thus, the location of the root is 2.5. 


Tabulation Method: In the tabulation method, a table of values of f(x) is made 
for values of x in a particular range. Then, we look for the change in sign in the 


Self-Instructional Values of f(x) for two consecutive values of x. We conclude that a real root lies 
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between these values of x. This is true if we make use of the following theorem on Methods for Finding 

! ; Complex Roots and 
continuous functions. Polynomial Equations 
Theorem 1: If f(x) is continuous in an interval (a, b) and f (a) and f(b) are of 


opposite signs, then there exists at least one real root of f (x) = 0, between a 
and b. NOTES 


Consider for example, the equation f(x) =x? - 8x+5=0 


Constructing the following table of x and f(x) 


x qc Im cq 3 
Yi -27 2 qd 12 5 -2 -3 8 


We observe that there is a change in sign of f(x) in each ofthe sub-intervals (—3, 
—4), (0, 1) and (2, 3). Thus we can take the crude approximation for the three real 
roots as — 3.2, 0.2 and 2.2. 


Methods for Finding the Roots—Bisection and Simple Iteration Methods 


Bisection Method: The bisection method involves successive reduction of the 
interval in which an isolated root of an equation lies. This method is based upon an 
important theorem on continuous functions as stated below. 
Theorem 2: Ifa function f (x) is continuous in the closed interval [a, b] and f(a) 
and f (b) are of opposite signs, i.e., f(a) f(b) < 0, then there exists at least one 
real root of f(x) = 0 between a and b. 
The bisection method starts with two guess values x, and x,. Then this interval 
ned ; 1 
[xp x, ] is bisected by a point x; = 5 0 +x,), where f(x9)- f (xj) « 0. We compute 
f (x,). If f (x,) = 0, then x, is a root. Otherwise, we check whether 
fo): f) «0 or fou): F(x) « 0. Iff (cy f(x,) < 0, then the root lies in the interval 
(x,, x,). Otherwise, if f(x;)- f(x) < 0, then the root lies in the interval (x, x,). 
The sub-interval in which the root lies is again bisected and the above process 
is repeated until the length ofthe sub-interval is less than the desired accuracy. 


The bisection method is also termed as a bracketing method, since the method 
successively reduces the gap between the two ends of an interval surrounding the 
real root, i.e., brackets the real root. 


The algorithm given below clearly shows the steps to be followed in finding a 
real root of an equation, by bisection method to the desired accuracy. 


Algorithm: Finding root using bisection method. 
Step 0: Define the equation, f(x) =0 
Step 1: Read epsilon, the desired accuracy 
Setp 2: Read two initial values x, and x, which bracket the desired root 
Step 3: Compute y, =f œ) 


Step 4: Compute i -f(x) pm E - 
Materia 


C sd. pii: Step 5: Check if y, y, « 0, then go to Step 6 

Polynomial Equations else go to Step 2 
Step 6: Compute x, = (x, + x,)/2 

NOTES Step 7: Compute y, — f (x,) 
Step 8: Check if y, y, > 0, then set x, =x, 
else set x, — x, 

Step 9: Check if | (x, ^ x$)/ x, | > epsilon, then go to Step 3 
Step 10: Write x,, y, 
Step 11: End 


Next, we give the flowchart representation ofthe above algorithm to get a 
better understanding of the method. The flowchart also helps in easy implementation 
of the method in a computer program. 


Flow Chart for Bisection Algorithm 


Compute y, = f (%) 


Compute y, =f x) 


Self-Instructional 
34 Material 


Example 2: Find the location ofthe smallest positive root of the equation x? — 9x Methods for Finding 


; . . ; Complex Roots and 
+ 1 =0 and compute it by bisection method, correct to two decimal places. Polynomial Equations 


Solution: To find the location of the smallest positive root we tabulate the function 


Zya . 
f (x) =x — 9x + 1 below: NOTES 


x 0 1 2 3 
fœ&@ 1 -2 -9 1 


We observe that the smallest positive root lies in the interval [0, 1]. The 


computed values for the successive steps ofthe bisection method are given in the 
Table. 


n Xi X X, f(x) 
1 0 1 0.5 -3.37 
2 0 0.5 0.25 -1.23 
3 0 0.25 0.125 — 0.123 
4 0 0.125 0.0625 0.437 

5 0.0625 0.125 0.09375 0.155 

6 0.09375 0.125 0.109375 0.016933 
7 0.109375 0.125 0.11718 — 0.053 


From the above results, we conclude that the smallest root correct to two 
decimal places is 0.11. 


Simple Iteration Method: A root of an equation f(x) = 0, is determined using 
the method of simple iteration by successively computing better and better 
approximation ofthe root, by first rewriting the equation in the form, 
x = g(x) (2.4) 
Then, we form the sequence {x } starting from the guess value x, of the root 
and computing successively, 


x, = g(x), X, = g(x), Xa = gG, 4) 


In general, the above sequence may converge to the root é as n >, or it 

may diverge. If the sequence diverges, we shall discard it and consider another 
form x = h(x), by rewriting f (x) = 0. It is always possible to get a convergent 
sequence since there are different ways of rewriting f (x) = 0, in the form x= g(x). 
However, instead of starting computation ofthe sequence, we shall first test whether 
the form of g(x) can give a convergent sequence or not. We give below a theorem 
which can be used to test for convergence. 
Theorem 3: If the function g(x) is continuous in the interval [a, b] which contains 
aroot & of the equation f (x) = 0, and is rewritten as x = g(x), and | g’(x)|</<1in 
this interval, then for any choice of x, e [a, b], the sequence {x } determined by 
the iterations, 
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Xp = 2(x,), for k=0, 1, 2,.. (2.5) 
This converges to the root of f(x) =0. 
Proof: Since x=€, is a root of the equation x = g(x), we have 
& = 8(6) (2.6) 
The first iteration gives x, = g(x,) (2.7) 
Subtracting Equation (2.7) from Equation (2.6), we get 
-=x = 8(5)— g(x) 


Applying mean value theorem, we can write 


-=x -(£-x9g' (so), xy «so «6 (2.8) 
Similarly, we can derive 
dx =(=- x )8 OS X «sec (2.9) 
= Xaa ERN. x <s, cf (2.10) 
From all these Equations (2.8), (2.9), and (2.10), we get 
E- Xp = (6-xy)g' Gy)... g',) (2.11) 


Since | g'(x,)| < / for each x, the above Equation (2.11) becomes, 
|£-x, 41 < I" |é-x, | (2.12) 


Evidently, since / € l, 7”*! — 0, as  — œ, the right hand side tends to zero and 
thus it follows that the sequence (x, ) converges to the root £ if |o'(£)| « 1. This 
completes the proof. 


Order of Convergence: The order of convergence of an iterative process is 
determined in terms of the errors e and B in successive iterations. An iterative 


Cn+1 


=< M, where Mis a finite 
en 


process is said to have Ath order convergence if lim 
nao 


number. 
Roughly speaking, the error in any iteration is proportional to the kth power of 
the error in the previous iteration. 


Evidently, the simple iteration discussed in this section has its order of 
convergence 1. 


The above iteration is also termed as fixed point iteration since it determines 
the root as the fixed point of the mapping defined by x = g(x). 


Algorithm: Computation ofa root of f(x) = 0 by linear iteration. 
Step 0: Define g(x), where f (x) = 0 is rewritten as x = g(x) 


Step 1: Input x, epsilon, maxit, where x, is the initial guess of root, epsilon is Methods for Finding 
Complex Roots and 


accuracy desired, maxit is the maximum number of iterations allowed. Polynomial Equations 
Step 2: Seti = 0 
Step 3: Set x, = g (xj) NOTES 


Step 4: Seti - i* 1 

Step 5: Check, if |(x, —x,)/x,| < epsilon, then print ‘root is’, x, 
else go to Step 6 

Step 6: Check, if i < n, then set x, =x, and go to Step 3 

Step 7: Write ‘No convergence after’, n, ‘iterations’ 

Step 8: End 


Example 3: In order to compute a real root of the equation x? — x — 1 = 0, near 
x= 1, by iteration, determine which of the following iterative functions can be 
used to give a convergent sequence. 


O x=8-1@) x=} Gig xm 
X 


Solution: 


(i) Forthe form x = x? -1, g(x) 2x9 — 1, and g'(x) 2332. Hence, | g'(x)| > 1, 
for x near 1. So, this form would not give a convergent sequence of 
iterations. 


f 1 1 1 2 
(ii) For the form x - 2, g(x)=~+. Thus, &'69- -— -—. and|g'(0| -3 > 1. 
X x d x 


Hence, this form also would not give a convergent sequence of iterations. 


1 
m _ fxtl no _ Lf x*l 2 1 
(iii) For the form, £6) - == £9) Al " | 


1 ] 
5 [gd zu < 1. Hence, the form x = pert would give a convergent 
X 


sequence of iterations. 


Example 4: Compute the real root ofthe equation x? +x? — 1 = 0, correct to five 
significant digits, by iteration method. 


Solution: The equation has a real root between 0 and 1 since f(x) =x? +x?— 1 
has opposite signs at 0 and 1. For using iteration, we first rewrite the equation in 
the following different forms. 


(i) reel (ii) ve fia (iii) "E 
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Poh a ois For the form (7), zœ) og (x) zi and for x in (0, 1), | g'G)| > 1. 


1 1 1 
So, this form is not suitable. For the form g'(x)=—. = s 1) (ii) and 
X 
E 
X 


NOTES 2 


le(x)| »1 for all x in (0, 1). Finally, for the form (iii) 


1 1 ; . 
g'(x)- x + and |g'(x)| « 1 for x in (0, 1). Thus this form can be used to form 
(x+ 1)2 


a convergent sequence for finding the root. 


We start the iteration x = with xcd The results of suecessive iterations 


1 
v1+x 
are, 

x,=0.70711 x, = 0.76537 x, =0.75236 x, = 0.75541 
X, =0.75476 x, =0.75490 x, =0.75488 x, = 0.75488 
Thus, the root is 0.75488, correct to five significant digits. 


Example 5: Compute the root of the equation x? — x — 0.1 = 0, which lies in 
(1,2), correct to five significant figures. 


Solution: The equation is rewritten in the following form for computing the root 
by iteration, 


x= ¥x+0.1. Here, s TTD and |g'(x)| < 1, for xin (1, 2). 


The results for successive iterations, taking x, — 1, are 
x = 1.0488 x,— 1.0718 x, = 1.0825 

x, = 1.0874 x, = 1.0897. 

Thus, the root is 1.09, correct to three significant figures. 


Example 6: Solve the following equation for the root lying in (2, 4) by using the 
method of linear iteration x? — 9x + 1 = 0. Show that there are various ways of 
rewriting the equation in the form, x — g (x) and choose the one which gives a 
convergent sequence for the root. 


Solution: We can rewrite the equation in the following different forms: 


(i) r=S 041) (ii) x= 9/x—— (iii) x= 9-— 


1 : DES A 
In case of (i), 2/6) = 3* and for x in [2, 4], | '() | > 1. Hence it will not give 


rise to a convergent sequence. 
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In case of form (ii) g'() = T and for xin [2, 4], | g/G) | > 1 
X X 


1 
In case of form (iii) g'(x) -[-4 ? = and |g'(x)| < 1 
x x 


Thus, the forms (7i) and (iii) would give convergent sequences for finding the 
root in [2, 3]. 

We start the iterations taking x, —2 in the iteration scheme (iii). The result for 
successive iterations are, 

x, = 2.0 x, = 2.91548 x, = 2.94282. 

x, = 2.94228 x, = 2.94281 

Thus, the root can be taken as 2.94281, correct to four decimal places. 


Newton-Raphson Method 


Newton-Raphson method is a widely used numerical method for finding a root of 
an equation f (x) = 0, to the desired accuracy. It is an iterative method which has 
a faster rate of convergence and is very useful when the expression for the derivative 
f (x) is not complicated. To derive the formula for this method, we consider a 
Taylor's series expansion of f (x, + A), x, being an initial guess of a root of 
f(x) =0 and h is a small correction to the root. 


2 
F(x th) = fl%) +h f) eL PG) 


Assuming / to be small, we equate f(x, + A) to 0 by neglecting square and 
higher powers of h. 


fo) *h fo) =9 


Or, ERE (Go) 
f'o) 
Thus, we can write an improved value ofthe root as, 
x =x% tA 
i.e., x-2Xx- £0) 
f œ) 


Successive approximations x», *3,..-, x,,; can thus be written as, 


"Ei 
T gn) 
TA 
EO 
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Xa+ Xa NIS (2.13) 
NOTES If the sequence {x,,} converges, we get the root. 


Algorithm: Computation ofa root of f(x) = 0 by Newton-Raphson method. 
Step 0: Define f(x), /'(x) 
Step 1: Input x,, epsilon, maxit 


[x, is the initial guess of root, epsilon is the desired accuracy ofthe 
root and maxit is the maximum number of iterations allowed] 


Step 2: Set ¿= 0 

Step 3: Set f, — f (x,) 

Step 4: Compute df, = f" (x,) 

Step 5: Set x, =x, — fy/df, 

Step 6:Seti=i+1 

Step 7: Check if |(x, —x,) |x,| € epsilon, then print ‘root is’, x, and stop 
else if i < n, then set x, =x, and go to Step 3 

Step 8: Write ‘Iterations do not converge’ 

Step 9: End 


Example 7: Use Newton-Raphson method to compute the positive root ofthe 
equation x? — 8x — 4 — 0, correct to five significant digits. 


Solution: Newton-Raphson iterative scheme is given by, 


xaX, fe.) , for n20,1,2,.. 
fx) 
For the given equation f(x) =x? - 8x — 4 
First we find the location of the root by the method of tabulation. The table for 
f(x)is, 


x 0 1 2 8 4 
JG -4 -13 -12 -1 28 


Evidently, the positive root is near x = 3. We take x, =3 in Newton-Raphson 
iterative scheme. 
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Similarly, x, = 3.05138, and x, = 3.05138 

Thus, the positive root is 3.0514, correct to five significant digits. 
Example 8: Find a real root of the equation x^ +7x° +9=0, correct to five 
significant digits. 
Solution: First we find the location ofthe real root by tabulation. We observe that 


the real root is negative and since f(—7) = 9 > 0 and f(—8) =— 55 <0, a root lies 
between —7 and - 8. 


For computing the root to the desired accuracy, we take x, = —8 and use 
Newton-Raphson iterative formula, 


Xp 7 X, EL for n-0,12,.. 
The successive iterations give, 
x, 05413125 
x, —-—7,17906 
x, = —7.17484 
a= = 717483 


Hence, the desired root is —7.1748, correct to five significant digits. 


Example 9: For evaluating Va, deduce the iterative formula x,., = i + iz) 


Xn 


by using Newton-Raphson scheme of iteration. Hence, evaluate /2 using this, 
correct to four significant digits. 


Solution: We observe that Va is the solution of the equation x? - a 7 0. 


Now, using f(x) =x? — a in the Newton-Raphson iterative scheme 


= na 
Xn 7 XS — 
2x, 
x? —a 
We have, Xa a X, m 
2x, 
dien 
XQ = XS — 
2x, 
1 a 
L.e., Xiu =| xX, +— |, for n=0,1, 2,.. 
2 X, 
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Polynomial Equations 
x = i 4 A)- = =1.414 
NOTES l ; 
X) ones J=1.41421 


Hence, the value of V2 is 1.414 correct to four significant digits. 


Example 10: Prove that ‘/, can be computed by the iterative scheme, 


1 AT. e 
ien L Dx, + n SS | Hence evaluate 3/2, connect to five significant digits. 


Solution: The value 4/7 is the positive root of x* — a = 0. Thus, the iterative 


scheme for evaluating £/; is, 


1 
or, X, = T Dx, + = | for n=0, 1, 2,... 
Xa 


Now, for evaluating 3/2, we take x, = 1.25 and use the iterative formula, 


1 2 
Xu = is 5 a 


n 


We have, ME 1.25x2+ z ;|71.26 
3 (1.25) 


x, =1.259921, x, 21.259921 


Hence, 3/7 — 1.2599, correct to five significant digits. 
Example 11: Find by Newton-Raphson method, the real root of 
3x—cos x — 1 7 0, correct to three significant figures. 
Solution: The location of the real root of f(x) = 3x — cos x — 1 70, is [0, 1] since 
f (0) 7» — 2 and f (1) > 0. 


We choose x, = 0, and use Newton-Raphson scheme of iteration. 


3x, — cos x,-1 


- , n20,1, 2,... 
3-sin x, 
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x, = 0.667, x, = 0.6075, x, = 0.6071 Polynomial Equations 
Thus, the root is 0.607 correct to three significant figures. 
Example 12: Find a real root of the equation x + 2x — 6 = 0, correct to four NOTES 


significant digits. 
Solution: Taking f (x) = x* + 2x — 6, we have f (1) =—3 < 0 and f (2) =2 > 0. 


Thus, a root lies in [1, 2]. Choosing x, = 2, we use Newton-Raphson iterative 
scheme given by, 


Xn 
x," +2x,-6 


for n=0, 1, 2,... 


n+l 


x,” log, x, -1)4-2' 


The computed results for successive iterations are, 


4*4- 

x22 PA. 102338 
4x(log, 2x" +1)+2 

x, = 1.72321 

x, = 1.72308 


Hence, the root is 1.723 correct to four significant figures. 


Order of Convergence: We consider the order of convergence of the Newton- 
Raphson method given by the formula, 


f(x) 
Xd n p 
I) 


Let us assume that the sequence of iterations {x,} converges to the root £. 
Then, expanding by Taylor's series about x , the relation f ( ¢ ) = 0, gives 


SODE- Ce) +5 E ox Perz 


Sn) 1 2 f") 
FE) A tE x). Fay? 
o la yc fons) 
Xu Š ~ 2 ($ x.) č T^) 
Taking £, as the error in the nth iteration and writing £, =, — 5, we have, 
1 f") 
fu aon e (2.14) 


Thus, ¢ ke?n, where kis a constant. 


nil 7 


This shows that the order of convergence of Newton-Raphson method is 2. 


In other words, the Newton-Raphson method has a quadratic rate of convergence. 
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Polynomial Equations derived by rewriting the Newton-Raphson iterative scheme as x,,, = g(x,) with 
X 
doses $ ( ) 
NOTES f(x) 
Hence, using the condition for convergence ofthe linear iteration method, we 
fx) f^) 


can write 9'(x) = — 
Lf Q0] 
Thus, the sufficient condition for the convergence of Newton-Raphson method 
is, 
| fco f'G) 


LA GO 


«Lin the interval near the root. 


i.e., FIONACIESEMCR (2.15) 


Secant Method 


Secant method can be considered as a discretized form of Newton-Raphson 
method. The iterative formula for this method is obtained from formula of Newton- 


Raphson method on replacing the derivative f'(x) by the gradient of the chord 
joining two neighbouring points x, and x, on the curve y — f (x). 


Thus, we have 


f). 60-60 


Xp 7 Xo 
The iterative formula is given by, 
B fo) 
X) = Xo 
f 0) - f (9) 


This can be rewritten as, 


(x, 7x9) 


x xo (x) 7 xV f (Xp) 
^ —— f (x)= fon) 


The iterative formula is equivalent to the one for Regula—Falsi method. The 
distinction between secant method and Regula—Falsi method lies in the fact that 
unlike in Regula—Falsi method, the two initial guess values do not bracket a root 
and the bracketing of the root is not checked during successive iterations, in secant 
method. Thus, secant method may not always give rise to a convergent sequence 
to find the root. The geometrical interpretation of the method is shown in Figure 
2.4. 
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Convergence Divergence 
(Line AB meets x-axis alone) 


Fig. 2.4 Secant Method 
Algorithm: To find a root of f(x) = 0, by Secant method. 
Step 1: Define f(x). 


Step 2: Input x, x,, error, maxit. [x,, x, are initial guess values, error is the 
prescribed precision and maxit is the maximum number of iterations 
allowed]. 


Step 3: Seti = 1 

Step 4: Compute f, =f x) 

Step 5: Compute f, =f (x,) 

Step 6: Compute x, = (x,f, -xN -h 
Step 7:Seti=i+1 

Step 8: Compute accy = |x, — x|| / b 

Step 9: Check if accy < error, then go to Step 14 
Step 10: Check if i > maxit then go to Step 16 
Step 11: Set x, — x, 

Step 12: Set x, =x, 

Step 13: Go to step 6 

Step 14: Print “Root =”, x, 

Step 15: Go to Step 17 

Step 16: Print ‘iterations do not converge’ 

Step 17: Stop 


Regula-Falsi Method 


Regula-Falsi method is also a bracketing method. As in bisection method, we 
start the computation by first finding an interval (a, b) within which a real root lies. 
Writing a = x, and b = x,, we compute f (x,) and f (x,) and check if f(x,) and f 
(x,) are of opposite signs. For determining the approximate root x,, we find the 
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point of intersection of the chord joining the points (x,, f(x,)) and (x, f(x,)) with 


the x-axis, i.e., the curve y = f (x,) is replaced by the chord given by, 
f 0) - f (9) 
x-x 


0 


y- F(X) 


(x — xg) 


Thus, by putting y = 0 and x =x, in Equation (2.16), we get 


"— f) 
2M FG) =F &) 


(x, Xo) 


(2.16) 


(2.17) 


Next, we compute f(x.) and determine the interval in which the root lies in the 
following manner. If (i) f (x,) and f (x) are of opposite signs, then the root lies in 
(x, x,). Otherwise if (ii) f(x,) and f (x) are of opposite signs, then the root lies 
in (x,, x). The next approximate root is determined by changing x, by x, in the 


first case and x, by x, in the second case. 


The aforesaid process is repeated until the root is computed to the desired 


accuracy £, i.e., the condition 


lx, —x,)/ x, | « e, should be satisfied. 


Regula-Falsi method can be geometrically interpreted by the following Figure 


2.5. 


xs f 0) 


Xo Sœ) 


Fig. 2.5 Regula-Falsi Method 
Algorithm: Computing root ofan equation by Regula-Falsi method. 
Step 1: Define f(x) 
Step 2: Read epsilon, the desired accuracy 
Step 3: Read maxit, the maximum no. of iterations 
Step 4: Read x,, x, two initial guess values of root 
Step 5: Compute f, =f (x,) 
Step 6: Compute f, =f (xj) 
Step 7: Check if f; f, <0, then go to the next step 
else go to Step 4 


Step 8: Compute x, = (x, f, — x, f) / (f, — f.) 

Step 9: Compute f, = f (x,) 

Step 10: Check if |//| < epsilon, then go to Step 18 

Step 11: Check iff, f, « 0 then go to the next Step 
else go to Step 15 

Step 12: Set x, — x, 

Step 13: Set f, — f, 

Step 14: Go to Step 7 

Step 15: Set x, — x, 

Step 16: Set f; — f, 

Step 17: Go to Step 7 

Step 18: Write ‘root =’, x,, f 

Step 19: End 


Example 13: Use Regula-Falsi method to compute the positive root ofx? — 3x— 
5 —0, correct to four significant figures. 


Solution: First we find the interval in which the root lies. We observe that f (2) = 
—3 and f (3) = 13. Thus, the root lies in [2, 3]. For using the Regula—Falsi method, 
we use the formula, 

f (x9) 
fo) - f (9) 


With x, = 2, and x, =3, we have 


(xı — Xo) 


X2 = X9 


X, =2+ 


3 (32) = 2.1875 
1343 


Again, since f (x,) = f (2.1875) = —1.095, we consider the interval 
[2.1875, 3]. The next approximation is x, = 2.2461. Also, f(x,) =—0.4128. Hence, 
the root lies in [2.2461, 3] 


Repeating the iterations, we get 
x, = 2.2684, f(x,) =— 0.1328 
x, = 2.2748, f(x.) == 0,0529 
xX, = 2.2773, f (x) = — 0.0316 
x, = 2.2788, f (x,) = — 0.0028 
x, = 2.2792, f(x.) = — 0.0022 


The root correct to four significant figures is 2.279. 
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Check Your Progress 


. How will you compute the roots of the form f (x) = 0? 
. Define tabulation method. 

. Explain bisection method. 

. How is order of convergence determined? 

. Explain Newton-Raphson method. 


. Define secant method. 


ND tA BW Nel 


. Explain Regula-Falsi method. 


2.3 POLYNOMIAL EQUATIONS 


Polynomial equations with real coefficients have some important characteristics 
regarding their roots. A polynomial equation of degree n is ofthe form p (x)= 


ax' ta qose Ge pog x taxta =O. 


(i) A polynomial equation of degree n has exactly n roots. 
(ii) Complex roots occur in pairs, i.e., if «+i £ isaroot ofp (x) = 0, then 
a —i f is also a root. 


(üi) Descarte's rule ofsigns can be used to determine the number of possible 
real roots (positive or negative). 

(iv) Ifx,, x,,..., x, are all real roots of the polynomial equation, then we can 
express p (x) uniquely as, 


p.) = a, (x= x)(x 7 x3)... (x - x4) 

(v) p,(x) has a quadratic factor for each pair of complex conjugate roots. 
Let, a+ifand a-ifbe the roots, then (x? -2ex« (o? + 8?)) is the 
quadratic factor. 


(vi) There is a special method, known as Horner's method of synthetic 
substitution, for evaluating the values ofa polynomial and its derivatives 
for a given x. 


Descarte's Rule 


The number of positive real roots ofa polynomial equation is equal to the number 
of changes of sign in p (x), written with descending powers of x, or less by an 
even number. 


Consider for example, the polynomial equation, 


3x! «42x! e x) -2x? e x -220 


Clearly there are three changes of sign and hence the number of positive real Methods for Finding 

: ; . Complex Roots and 

roots is three or one. Thus, it must have a real root. In fact, every polynomial Polynomial Equations 
equation ofodd degree has a real root. 

We can also use Descarte’s rule to determine the number ofnegative roots by 


finding the number of changes of signs in p (—x). For the above equation, ROTES 


p, (=x) = -3x7 «2x* - ó - 23? -x-2 =0; and it has two changes of sign. Thus, it 
has either two negative real roots or none. 


Check Your Progress 


8. Define polynomial equations. 


9. Give the statement of Descarte's rule. 


2.4 ANSWERS TO CHECK YOUR PROGRESS 
QUESTIONS 


1. We consider numerical methods for computing the roots ofan equation of the 
form, 


f(x) -0 
Where f(x) is a reasonably well-behaved function ofa real variable x. 


2. In the tabulation method, a table of values of f(x) is made for values of x in 
a particular range. Then, we look for the change in sign in the values of f(x) 
for two consecutive values of x. We conclude that a real root lies between 
these values of x. 


3. The bisection method involves successive reduction ofthe interval in which 
an isolated root of an equation lies. 


The sub-interval in which the root lies is again bisected and the above 
process is repeated until the length ofthe sub-interval is less than the desired 
accuracy. 


The bisection method is also termed as a bracketing method, since the 
method successively reduces the gap between the two ends of an interval 
surrounding the real root, i.e., brackets the real root. 


4. The order of convergence ofan iterative process is determined in terms of 
the errors e, and e, , in successive iterations. 


5. Newton-Raphson method is a widely used numerical method for finding a 
root of an equation f (x) — 0, to the desired accuracy. It is an iterative method 
which has a faster rate of convergence and is very useful when the expression 
for the derivative f (x) is not complicated. To derive the formula for this 
method, we consider a Taylor's series expansion of f(x, + A), x, being an 
initial guess ofa root of f(x) = 0 and / is a small correction to the root. 
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6. Secant method can be considered as a discretized form of Newton-Raphson 
method. The iterative formula for this method is obtained from formula of 
Newton-Raphson method on replacing the derivative f'(x) by the gradient 
ofthe chord joining two neighbouring points x, and x, on the curve y — f (x). 

7. Regula-Falsi method is also a bracketing method. As in bisection method, we 
start the computation by first finding an interval (a, b) within which a real root 
lies. Writing a =x, and b= x, we compute f (x,) and f(x,) and check if f (x,) 
and f (x,) are of opposite signs. For determining the approximate root x,, we 
find the point of intersection of the chord joining the points (x,, f (x,)) and (x,, 
f (x,)) with the x-axis, i.e., the curve y =f (x) is replaced by the chord given 
by, 


y-f(x)- 


f 01) - f Gg) cm) 
X7 Xo 
8. A polynomial equation of degree is ofthe form p (x)= a x' +a, x" + 


n-2 2 = 
a X° +t.. tax taxta =O. 


9. The number of positive real roots ofa polynomial equation is equal to the 
number of changes of sign in p (x), written with descending powers of x, or 
less by an even number. 


2.5 SUMMARY 


e A root of an equation is usually computed in two stages. First, we find the 
location of a root in the form of a crude approximation of the root. Next 
we use an iterative technique for computing a better value of the root to a 
desired accuracy in successive approximations/computations. 


e Tabulation Method: In the tabulation method, a table of values of f(x) is 
made for values of x in a particular range. 

e Thebisection method involves successive reduction of the interval in which 
an isolated root of an equation lies. 

e Ifa function f(x) is continuous in the closed interval [a, b] and f(a) and f 
(b) are of opposite signs, i.e., / (a) f(b) <0, then there exists at least one 
real root of f(x) = 0 between a and b. 

e The bisection method is also termed as a bracketing method, since the 
method successively reduces the gap between the two ends of an interval 
surrounding the real root, i.e., brackets the real root. 

e Ifthe function g(x) is continuous in the interval [a, b] which contains a root 
é ofthe equation f(x) = 0, and is rewritten as x = g(x), and | g(x)| < Z x 1in 
this interval, then for any choice of x, e [a, b], the sequence {x } determined 
by the iterations, 
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Xp = g(x,), for k=0, 1, 2,.. 
This converges to the root of f(x) — 0. 


* Order of Convergence: The order of convergence of an iterative process is 


determined in terms of the errors e, and e „ in successive iterations. An NOTES 


E š . x . : e 
iterative process is said to have Ath order convergence if lim 77 < M, 
nao en 


where M is a finite number. 

e Newton-Raphson method is a widely used numerical method for finding a 
root of an equation f (x) = 0, to the desired accuracy. 

e Secant method can be considered as a discretized form of Newton-Raphson 
method. The iterative formula for this method is obtained from formula of 
Newton-Raphson method on replacing the derivative f'(x)) bythe gradient 
ofthe chord joining two neighbouring points x, and x, on the curve y =f 
(x). 

e Descarte’s rule of signs can be used to determine the number of possible 
real roots (positive or negative). 

e Ifx,,x,,...,x, are all real roots of the polynomial equation, then we can 
express p (x) uniquely as, 


p, (x) = a, Qc x — x3)... (x Xp) 
e We can also use Descarte's rule to determine the number of negative 
roots by finding the number of changes of signs in p (x). 


2.0 KEY WORDS 


e Graphical Method: In the graphical method, we draw the graph ofthe 
function y =f (x), for a certain range of values of x. 


e Tabulation Method: In the tabulation method, a table of values of f(x) is 
made for values of x in a particular range. 


e Order of Convergence: The order of convergence ofan iterative process 
is determined in terms of the errors e, and e „ in successive iterations. 


2.] SELF ASSESSMENT QUESTIONS AND 
EXERCISES 


Short-Answer Questions 


1. Whatis tabulation method? 
2. Whatis bisection method? 
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3. Define Newton-Rapshon method. 
4. Whatis meant by secant method? 
5. Explain Regula-Falsi method. 
Long-Answer Questions 
1. Use graphical method to find the location ofa real root of the equation x? + 
10x- 15-0. 


2. Draw the graphs of the function f (x) = cos x — x, in the range [0, 1/2) and 
find the location of the root ofthe equation f (x)= 0. 


3. Compute the root of the equation x? — 9x + 1 2 0 which lies between 2 and 3 
correct upto three significant digits using bisection method. 


4. Compute the root of the equation x? + x? — 1 = 0, near 1, by the iterative 
method correct upto two significant digits. 


5. Use iterative method to find the root near x = 3.8 ofthe equation 2x — log, x 
— 7 correct upto four significant digits. 


6. Compute using Newton-Raphson method the root of the equation e = 4", 
near 2, correct upto four significant digits. 
7. Use an iterative formula to compute 4/125 correct upto four significant digits. 


8. Find the real root of x log x — 1.2 = O correct upto four decimal places using 
Regula-Falsi method. 


9. Use Regula-Falsi method to find the root ofthe following equations correct 
upto four significant figures: 


(i) xX - 4x — 1 7 0, the root near x = 2 
(ii) x6 — x* — xà — 1 = 0, the root between 1.4 and 1.5 


10. Compute the positive root ofthe given equation correct upto four places of 
decimals using Newton-Raphson method: 


x-tlog x-2 
2.8 FURTHER READINGS 


Jain, M. K., S. R. K. Iyengar and R. K. Jain. 2007. Numerical Methods for 
Scientific and Engineering Computation. New Delhi: New Age 
International (P) Limited. 

Atkinson, Kendall E. 1989. An Introduction to Numerical Analysis, 2nd Edition. 
US: John Wiley & Sons. 

Jain, M. K. 1983. Numerical Solution of Differential Equations. New Delhi: 
New Age International (P) Limited. 


Conte, Samuel D. and Carl de Boor. 1980. Elementary Numerical Analysis: Methods for Finding 
Complex Roots and 


An Algorithmic Approach. New York: McGraw-Hill. Polynomial Eguañons 


Skeel, Robert. D and Jerry B. Keiper. 1993. Elementary Numerical Computing 
with Mathematica. New York: McGraw-Hill. 


Balaguruswamy, E. 1999. Numerical Methods. New Delhi: Tata McGraw-Hill. 


Datta, N. 2007. Computer Oriented Numerical Methods. New Delhi: Vikas 
Publishing House Pvt. Ltd. 


NOTES 


Self-Instructional 
Material 53 


Birge — Vieta, Bairstow's 
and Graeffe's Root 
Squaring Methods 


54 


NOTES 


Self-Instructional 
Material 


UNIT 3 BIRGE - VIETA, 
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3.8 Self-Assessment Questions and Exercises 
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3.0 INTRODUCTION 


In mathematics, a polynomial is an expression consisting of variables (also called 
indeterminate) and coefficients that involves only the operations of addition, 
subtraction, multiplication, and non-negative integer exponents of variables. The 
polynomial ofa single indeterminate, x, is x? — 4x + 7 while in three variables it is 
X? + 2xyz? — yz + 1. A polynomial equation is, therefore, an equation that has 
multiple terms made up of numbers and variables. The degree tells us how many 
roots can be found in a polynomial equation. For example, if the highest exponent 
is 3, then the equation has three roots. The roots ofthe polynomial equation are 
the values of x where y = 0. Principally, the polynomial equation is an equation of 
the form f(x) = 0 where f(x) is a polynomial in x. 


Thesixteenth century French mathematician Francois Vieta was the pioneer 
to develop methods for finding approximate roots of polynomial equations. Later, 
several other methods were developed for solving polynomial equations. In 
numerical analysis, Bairstow's method is an efficient algorithm for finding the roots 
ofareal polynomial ofarbitrary degree. The algorithm first appeared in the appendix 
of the 1920 book ‘Applied Aerodynamics’ by Leonard Bairstow. The algorithm 
finds the roots in complex conjugate pairs using only real arithmetic. The Graeffe’s 
root squaring method is a direct method to find the roots of any polynomial equation 
with real coefficients. Polynomials are used to form polynomial equations, which 
encode a wide range of problems, from elementary word problems to complicated 
scientific problems. 


In this unit, you will study about the Birge-Vieta method, the Bairstow's Birge — Vieta, Bairstow's 


: and Graeffe's Root 
method, and the Graeffe's root squaring method. Squaring Methods 


3.1 OBJECTIVES NOTES 


After going through this unit, you will be able to: 
* Discuss the Birge-Vieta method 
e Understand the Bairstow's method 


e Elaborate on the Graeffe's root squaring method 


3.2 BIRGE — VIETA METHOD 


Birge-Vieta method is used for finding the real roots ofa polynomial equations. 
This method is based on an original method developed by the two English 
mathematicians Birge and Vieta. Finding and approximating the derivation of all 
roots of a polynomial equation is a very significant. In the field of science and 
engineering, there are numerous applications which require the solutions of all 
roots of a polynomial equations for a particular problem. 


Newton-Raphson method is fundamentally used for finding the root of an 
algebraic and transcendental equations. Since the rate of convergence of this method 
is quadratic, hence the Newton-Raphson method can be used to find a root ofa 
polynomial equation as polynomial equation is an algebraic equation. Birge-Vieta 
method is based on the Newton-Raphson method or this method is a modified 
form of Newton-Raphson method. 


Consider the given polynomial equation of degree n, which has the form, 
= 0. 


Let x, be an initial approximation to the root o. The Newton-Raphson 
iterated formula for improving this approximation is, 


PŒ) =ax +t... ae cu 


0 


PS. 
a 
Xi Xi- | pas _ 1) 


i ee 


To apply this formula, first evaluate both P (x) and P" (x,) at any x, The 
utmost natural method is to evaluate, 


‘Yoo a" ae n-i 2.x* 41 : 
P(X) =a Xo ta, X; c... aK cR aX + ay 


‘ — : n-! - 7 n-2 5. 
pax) =n 4x, +(n l)a ži +... +2a,x +a 
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Squaring Methods polynomial, because ofthe amount of computations involved and also because of 
the possible growth of round off errors. Thus there must be some proficient and 


effective method for evaluating P (x) and P" (x). 


NOTE? Vieta’s formula is used for the coefficients of polynomial to the sum and 


product of their roots, along with the products of the roots that are in groups. 
Vieta’s formula defines the association of the roots of a polynomial by means of its 
coefficients. Following example will make the concept clear that how to find a 
polynomial with given roots. 


Here we will discuss about the real-valued polynomials, i.e., the coefficients 
of polynomials are real numbers. 


Consider a quadratic polynomial. If the given two real roots are r, andr, 
then find a polynomial. 


Let the polynomial is a,x” + a,x + a,. When the roots are given, then we 
can also write the polynomial equation in the form, k (x—r,) (x— r.). 


Since both the equations denotes the same polynomial, therefore equate 
both polynomials as, 


ax taxtay-k(x-r)(x-r,) (3.1) 
On simplifying the Equation (3.1), we have the following form of equation, 
ax taxta KR -kr tr )xtk(rr) 
Comparing the coefficients of both the sides of the above equation, we 
have, 


For x, a,=k 


For x,a = on) 
For constant term, a, = krr, 
Which gives, 
a,=k 
Therefore, 
a ` 
+ = —(r1 +12) (3.2) 
ar , 
—0 — rro (3.3) 


Equations (3.2) and (3.4) are termed as Vieta's formulas for a second degree 
polynomial. 

Asa general rule, for an nth degree polynomial, there are n different Vieta’s 
formulas which can be written in a condensed form as, 
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e" — p 1) 5 n-k 
2 acies. sten Ph Tig fi) = (-1) row 


Example 1: Find all the roots of the given polynomial equation P(x) =x* +x—3 
= 0 rounded off to three decimal places. Stop the iteration whenever 1x, , —x,} < 
0.0001. 


Solution: The equation P(x) = 0 has three roots. Since there is only one change 
in the sign of the coefficients, the equation can have as amaximum one positive 
real root. The equation has no negative real root since P (~x) = 0 has no change of 
sign of coefficients. Since P (x)= 0 is of odd degree it has at least one real root. 
Hence the given equation x? + x —3 =0 has one positive real root and a complex 
pair. Since P(1) — —1 and P(2) = 7, as per the intermediate value theorem the 
equation has a real root lying in the interval ]1,2[. 


Now we will find the real root using Birge-Vieta method. Let the initial 
approximation be 1.1. 


First Iteration 


l 0 14 3 
11 11 121 2431 
Iio oo ua 221 — | ose 
1.1 L] 2 mM 
i 1 22. 4.63 | 


Therefore x, = 1.1 —(-0.569)/4.63 = 1.22289 


Similarly, 
x, = 1.21347 
x, = 1.21341 


Since, | x, —x,| < 0.0001, we stop the iteration here. Hence the required 
value ofthe root is 1.213, rounded offto three decimal places. 


Next we will find the deflated polynomial of P (x). To obtain the deflated 
polynomial, we have to first find the polynomial q. (x) by using the final approximation 
x, 71.213, as shown in the following table. 


l 0 1 -3 


1.213 1.213 ` 1.4714 2.9978 
= " I | 


| 1 1.213 (2.4714 -0.0022 


Here, P, (1.213) =— 0.0022, i.e., the magnitude ofthe error in satisfying 
P (x) = 0 is 0.0022. 


We then find q,(x) =x? + 1.213 x + 2.4714 - 0 
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This is a quadratic equation and its roots are given by, 


-1.213 + (1.213) - 4 x 2.4714 


2 
|. 21.213 + 2.9009 i 
i 2 

— 0.6065 + 1.4505 i 


Hence the three roots of the equation rounded off to three decimal places 
are 1.213, 0.6065 + 1.4505 i and — 0.6065 — 1.4505 i. 


x= 


3.3 BAIRSTOW’S METHOD 


In numerical analysis, Bairstow’s method is an efficient algorithm for finding the 
roots ofa real polynomial of arbitrary degree. The algorithm was formulated by 
Leonard Bairstow and first appeared in the appendix of the book *Applied 
Aerodynamics’ (1920). The algorithm finds the roots in complex conjugate pairs 
using only real arithmetic. 


Bairstow’s approach is to use Newton’s method to adjust the coefficients u 
and v in the quadratic x? + ux + v until its roots are also roots ofthe polynomial 
being solved. Theroots ofthe quadratic may then be determined, and the polynomial 
may be divided by the quadratic to eliminate those roots. This process is then 
iterated until the polynomial becomes quadratic or linear, and all the roots have 
been determined. 

Long division ofthe polynomial to be solved as, 

m 
P(t) — D a,x" 


i-0 


By x? + ux + v yields a quotient, 


And a remainder cx + d such that, 


n-2 
P(x) = (z? 4. uz 4. v) (Saa) !: (ez 4- d) 
i-0 


A second division of Q(x) by x? + ux + vis performed to yield a quotient, 


R(z) = y fa 
i=0 


b= 
b; 
c= aj — ubo — vb, 


And a remainder gx + h with, 


n—4 
Q(x) = (z^ + uz + v) >; fix" | + (gz +h) 
i=0 


The variables c, d, g, h and the (5.5, {f} are functions ofu and v. They can 
be found recursively as follows, 


a1 = 0, 


= 0442 — tubi i 


d = ay — vby, 


€ (u, v) 


A = 
fi = bus — ufiai — vfi 
g=bħ —ufo —vfi, 


— ubi+2 


fai - 0, 


h = bo — v fo- 
The quadratic evenly divides the polynomial when, 


=d(u, v)=0 


43-4.) 


Values of u and v for which this occurs can be discovered by picking starting 
values and iterating Newton's method in two dimensions as, 


de æ! 
-ija a| [bm e] rir d le 
i ad od! |dj]' |v ? 4 h(h — E EI, 
v ôi 2i vg) +h(h— ug) | -gv gu—h| lé 
This continues until convergence occurs. This method to find the zeroes of 


polynomials can thus be easily implemented with a programming language or even 
a spreadsheet. 


au & 


Example 2: The task is to determine a pair of roots of the polynomial, 
f(x) =6x54+ 11 x4 -33x -332°+ 11 x+6 


Solution: As first quadratic polynomial we can use the normalized polynomial 


formed from the leading three coefficients of f(x), 
33 


4—1 11 
u= — = —; 


ün 


6 3 


_ Gn-2 


(s 6 


The iteration then produces as shown in the following table. 


Iteration Steps of Bairstow's Method 


u 


1.833333333333 
2.979026068546 
3.635306053091 


3.064938039761 


| 3.461834191232 
| 3.326244386565 
| 3.333340909351 
| 3.333333333340 


3.333333333333 


Vv 


step length 


-5.500000000000 | 5.579008780071 


-0.039896784438 | 2.048558558641 


1.900693009946 
0.193530875538 
1.385679731101 
| 0.978742927192 
1.000022701147 
| 1.000000000020 
1.000000000000 


1.799922838287 
1.256481376254 
0.428931413521 


0.022431883898 
0.000023931927 


0.000000000021 
0.000000000000 


roots 
| —0.916666666667+2.517990821623 
| —1.489513034273+1.502845921479 
| —-1.81765302654521.184554563945 
| —1.53246901988121.467968126819 
| -1.73091709561641.269013105052 
| —1.66312219328241.336874153612 
| —1.666670454676+1.333329555414 
| —1.66666666667041.333333333330 
| -1.666666666667 +1.333333333333 
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pucr — Mieta, ni After eight iterations the method produced a quadratic factor that contains 
ii t 314: ie 
NN ecd. the roots —1/3 and —3 within the represented precision. The step length from the 
fourth iteration on demonstrates the superlinear speed of convergence. 


NOTES |34 GRAEFFE'S ROOT SQUARING METHOD 


In mathematics, Graeffe's method or Dandelin—Lobachesky—Graeffe method is 
an algorithm typically used for finding all ofthe roots of a polynomial. It was 
developed independently by Germinal Pierre Dandelin in 1826 and Lobachevsky 
in 1834. In 1837 Karl Heinrich Gráffe also discovered the principal idea ofthe 
method. The method separates the roots of a polynomial by squaring them 
repeatedly. This squaring of the roots is done implicitly, that is, only working on 
the coefficients ofthe polynomial. Finally, Viéte's formulas are used in order to 
approximate the roots. 


Dandelin-Graeffe Iteration 
Let p(x) be a polynomial of degree n, 
p(x) = (£ — 21) --- (z — £n) 
Then, 
p(—«x) = (-1y'(z 4-21) -- (£+ £n) 


2 


2 . 
potra En as its 


Let q(x) be the polynomial which has the squares 3: 


roots, 


qlz) = (« — 2?) --- (a — ad) 


Then we can denote as, 


q(z?) = (x? — 22) --- (z? — z2) 
= (z—azi)r-42z)--(z—z4)(z--z) 
= (z—z)::-(x—24)) x ((z-2)---(24- 24)) 
= p(z) x {(—1)"(—2 — 21) +++ (72 — 24) 
= p(z) x ((-1)^p(-2)) 
= (-1)"9(2)p(~2) 


Next g(x) can now be computed by algebraic operations on the coefficients 
of the polynomial p(x) alone. 
Let, 


p(x) = z” 4-a,2" l2... 4: MET a A 


g(a) = a" 4- ba" | 4+---4+db, a+b, 
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Then the coefficients are related by, Birge- foe Ws s pai 
and Graeffe's Roo 
Squaring Methods 


k-1 
by = (—1)*a? + 25 '(-1y (4k, aj =b —1 
m NOTES 


Graeffe observed that if one separates p(x) into its odd and even parts, 
then 


p(x) = pe (z^) + ze (2^) 
We now obtain a simplified algebraic expression for g(x) of the form, 
q(x) = (—1)" (pe (z)* — zp.()^) 


This expression involves the squaring of two polynomials of only half the 
degree, and is therefore used in most implementations of the method. 

Iterating this procedure several times separates the roots with respect to 
their magnitudes. Repeating k times gives a polynomial of degree n, we have: 


l peeta a yd o*, 


k k 
q (y) =y” +a yy" 
With roots, 
2* E >; ——— 
yi —741592 = 15 ye ees Un = Tn - 
Ifthe magnitudes ofthe roots ofthe original polynomial were separated by 


some factor p 71, that is, |æ} | > o2, |, then the roots of the k-th iterate are 


separated by a fast growing factor, 
ak . n 
pP >1+2*(p—1) 


Next the Vieta relations are used as Classical Graeffe’s method as shown 
below: 


a^ = (y +yz + ys) 
af, = Y1 Y2 + YY too Yn-iYn 


afn = (—1)" (yy * ** Yn). 


If the roots ¥1,---,n are sufficiently separated, say by a factor 


p L1. |Em| > pi£52|, then the iterated powers 91:32; -- 5 Un of the 
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roots are separated by the factor p , which quickly becomes very big. The 


coefficients ofthe iterated polynomial can then be approximated by their leading 
term, 
a^ & —yi 
a^, œ% yi and so on, 
Implying, 
y = af, » Y2 — a*, /a*, jv f a fats " 
Finally, logarithms are used in order to find the absolute values ofthe roots 


oftheoriginal polynomial. These magnitudes alone are already useful to generate 
meaningful starting points for other root-finding methods. 


Check Your Progress 
1. Why the Birge-Vieta method is used? 


2. How the Bairstow's approach uses Newton's method for adjusting the 
coefficients u and v in the quadratic x?-- ux + v? 


3. Explain Graeffe's method. 


3.5 ANSWERS TO CHECK YOUR PROGRESS 
QUESTIONS 


1. Birge-Vieta method is used for finding the real roots of a polynomial 
equations. 


2. Bairstow's approach is to use Newton’s method to adjust the coefficients u 
and v in the quadratic x? + ux + v until its roots are also roots of the 
polynomial being solved. The roots ofthe quadratic may then be determined, 
and the polynomial may be divided by the quadratic to eliminate those roots. 
This process is then iterated until the polynomial becomes quadratic or 
linear, and all the roots have been determined. 


3. Graeffe's method or Dandelin-Lobachesky-Graeffe method is an algorithm 
typically used for finding all ofthe roots ofa polynomial. It was developed 
independently by Germinal Pierre Dandelin in 1826 and Lobachevsky in 
1834. The method separates the roots ofa polynomial by squaring them 
repeatedly. This squaring ofthe roots is done implicitly, that is, only working 
on the coefficients ofthe polynomial. Finally, Viéte's formulas are used in 
order to approximate the roots. 


Birge — Vieta, Bairstow's 


3.6 SUMMARY and Graeffe's Root 
-E Squaring Methods 
e Birge-Vieta method is used for finding the real roots ofa polynomial equations. 
This method is based on an original method developed by the two English NOTES 
mathematicians Birge and Vieta. 


Finding and approximating the derivation ofall roots ofa polynomial equation 
isa very significant. In the field of science and engineering, there are numerous 
applications which require the solutions ofall roots ofa polynomial equations 
for a particular problem. 


e Newton-Raphson method is fundamentally used for finding the root of an 
algebraic and transcendental equations. 


Since therate of convergence ofthis method is quadratic, hence the Newton- 
Raphson method can be used to find a root of a polynomial equation as 
polynomial equation is an algebraic equation. 


Birge-Vieta method is based on the Newton-Raphson method or this method 
is a modified form of Newton-Raphson method. 


The most inefficient method ofevaluating a polynomial, because ofthe amount 
of computations involved and also because ofthe possible growth ofround 
off errors. Thus there must be some proficient and effective method for 
evaluating P (x) and P" (x). 

e Vieta's formula is used for the coefficients of polynomial to the sum and 
product oftheir roots, along with the products ofthe roots that are in groups. 


e Vieta's formula defines the association ofthe roots of a polynomial by means 
of its coefficients. Following example will make the concept clear that how 
to find a polynomial with given roots. 


e Asageneral rule, for an nth degree polynomial, there are n different Vieta's 
formulas which can be written in a condensed form as, 


0<k<n 
For 


" -— - — kan 4 
3 vei disc ciun Tara Tid m [^ L) = 


e Innumerical analysis, Bairstow’s method is an efficient algorithm for finding 
the roots of a real polynomial of arbitrary degree. 


The algorithm was formulated by Leonard Bairstow. The algorithm finds 
the roots in complex conjugate pairs using only real arithmetic. 


e Bairstow’s approach uses Newton's method to adjust the coefficients u 
and v in the quadratic x? + ux + v until its roots are also roots of the 
polynomial being solved. 
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Birge — Vieta, Bairstow's e Theroots ofthe quadratic may then be determined, and the polynomial 

and Graeffe's Root PM ! oA A : 

Squaring Methods may be divided by the quadratic to eliminate those roots. This process is 
then iterated until the polynomial becomes quadratic or linear, and all the 


roots have been determined. 


NOTES e [n mathematics, Graeffe's method or Dandelin-Lobachesky-Graeffe 


method is an algorithm typically used for finding all of the roots ofa 
polynomial. It was developed independently by Germinal Pierre Dandelin 
in 1826 and Lobachevsky in 1834. In 1837 Karl Heinrich Graffe also 
discovered the principal idea ofthe method. 


The Graeffe's method separates the roots ofa polynomial by squaring them 
repeatedly. This squaring ofthe roots is done implicitly, that is, only working 
on the coefficients ofthe polynomial. Finally, Viéte's formulas are used in 
order to approximate the roots. 


e In Graeffe's method, the logarithms are used in order to find the absolute 
values ofthe roots ofthe original polynomial. These magnitudes alone are 
already useful to generate meaningful starting points for other root-finding 
methods. 


3.7 KEY WORDS 


e Birae-Vieta method: This method is used for finding the real roots ofa 
polynomial equations. 


e Bairstow's method: This is an efficient algorithm for finding the roots ofa 
real polynomial ofarbitrary degree. The algorithm was formulated by Leonard 
Bairstow for finding the roots in complex conjugate pairs using only real 
arithmetic. 


e Graeffe's method or Dandelin-Lobachesky-Graeffe method: It is 
an algorithm typically used for finding all ofthe roots ofa polynomial. 


3.8 SELF-ASSESSMENT QUESTIONS AND 
EXERCISES 


Short-Answer Questions 


1. Why is Birge-Vieta method used? 
2. Define Bairstow's method. 


3. Whatisthe significance of Graeffe's root squaring method? 
Long-Answer Questions 


1. Briefly explain the Birge-Vieta method giving appropriate examples. 
2. Find the root of x? - 3x? + 332 - 3x + 2 = 0 using Birge-Vieta method. 
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3. Explain the Bairstow's method with the help ofexamples. 
4. Using Bairstow’s method find all the roots of a given polynomial, 


fa(z) = ag + aix + aaz? +... + yr” 


5. Discuss the Graeffe’s root squaring method giving appropriate examples. 
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NOTES LINEAR EQUATION 


Structure 
4.0 Introduction 
4.1 Objectives 
4.2 System of Linear Equations 
4.2.1 Classical Methods 
42.2 Elimination Methods 
42.3 Iterative Methods 
4.2.4 Computation of the Inverse of a Matrix by using Gaussian Elimination 
Method 
4.3 Answers to Check Your Progress Questions 
4.4 Summary 
4.5 Key Words 
4.6 Self Assessment Questions and Exercises 
4.7 Further Readings 


4.0 INTRODUCTION 


Many engineering and scientific problems require the solution based on system of 
linear equations. The system of equations is termed as a homogeneous type if all 
the elements in the column vector b are zero else the system is termed as a non- 
homogeneous type. You will learn the method of computation to find the solution 
ofa system of 7 linear equations in n unknowns. Two types of efficient numerical 
methods are used for computing solution of systems of equations, of which some 
are direct methods and others are iterative in nature. In the direct method, Gaussian 
elimination method is used while in the iterative method, Gauss-Seidel iteration 
method is commonly used. You will learn the two forms of iteration methods termed 
as Jacobi iteration method and Gauss-Seidel iteration method. 


In this unit, you will study about the transcendental and polynomial equations 
and rate of convergence of iterative methods. 


4.1 OBJECTIVES 


After going through this unit, you will be able to: 
e Explain the system of linear equations 
e Understand Cramer’s rule 


e Explain Gaussian elimination method and Gauss-Jordan elimination method 
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e Define Jacobi iteration method and Gauss-Seidel iteration method Solution of Simultaneous 
Linear Equation 


e Compute inverse ofa matrix using Gaussian elimination method 


4.2 SYSTEM OF LINEAR EQUATIONS NOTES 


Many engineering and scientific problems require the solution ofa system of linear 
equations. We consider a system of m linear equations in n unknowns written as, 


Qj X, dX, dX, t... ax, =), 

dX, + dX, 5X, +... + A,X, = b, 

d3,X, + Ay Xy  d34X, +... ds, X, = b, (4.1) 
an H OX» 3X3 Fed OX, = b, 


Using matrix notation, we can write the above system of equations in the 
form, 
Ax-b (4.2) 
where A is a m * n matrix and x, b are respectively n-column, m-row vectors 
given by, 


4, Ay dy a, x b 
44, Ay 5 a, X% b, 
A=| da dy 43; d, h x=| x |, bz-|b, (4.3) 
Rm Am2 an3 see Amn d bx, d [ 5, J 


The system ofequations is termed as a homogeneous one, ifall the elements in 
the column vector 5 are zero. Otherwise, the system is termed as a non- 
homogeneous one. 


The homogeneous system has a non-trivial solution, if A is a square matrix, 1.e., 
m — n, and the determinant of the coefficient matrix, i.e., |4| is equal to zero. 


The solution ofthe non-homogeneous system exists, if the rank of the coefficient 
matrix A is equal to the rank of the augmented matrix [A : b] given by, 


d A. dj Ay, D 

Ay, an G5 . Any b 

[A : b] = a3) 355 33 x O35 b, 
[du an aM os Am D, 


Further, a unique non-trivial solution ofthe system given by Equation (4.1) 
exists when m =n and the determinant | 4| + 0, i.e., the coefficient matrix is a 
square non-singular matrix. The computation ofthe solution ofa system ofn linear 


equations in 7 unknowns can be made by any one ofthe two classical methods 
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known as the Cramer's rule and the matrix inversion method. But these two 
methods are not suitable for numerical computation, since both the methods require 
the evaluation of determinants. There are two types of efficient numerical methods 
for computing solution of systems of equations. Some are direct methods and 
others are iterative in nature. Among the direct methods, Gaussian elimination 
method is most commonly used. Among the iterative methods, Gauss-Seidel 
iteration method is very commonly used. 


4.2.1 Classical Methods 


Cramer’s Rule: Let D=|A| be the determinant of the coefficient matrix A and D, 
be the determinant obtained by replacing the ith column of D by the column vector 
b. The Cramer’s rule gives the solution vector x by the equations, 


D, 


x= 


i 


,forizl2,.,n 
(4.4) 
Thus we have to compute (n + 1) determinants of order n. 
Example 1: Use Cramer's rule to solve the following system: 
2 -3 1x] [1 
3 1 -Ilx ]l=|2 
1 -1 -lx [1 


Solution: The determinant D ofthe coefficient matrix is, 


-3 1 
D=|3 1 -1/=2(-1-1)-3(-1+3)+(-3-1) = -14 
b =p =i 


The determinants D,, D, and D, are, 


£c ud 

D,=|2 1 -l=(-1-1)-3(-1+2)+(-2-1) =-8 
1 -1 -1 
2 1 1 

D,-3 2 -1)=2(-2+1)+(-14+3)+@G-2)=1 
bie 
23-1 

D,-3 1 2|-2042)-3(2-3)-(-3-1)-5 
i =i i 


Hence by Cramer's rule, we get 


Pest om d D, 5 
D -14 7 ? D qe D 14 


x 


4.2.2 Elimination Methods Solution of Simultaneous 


Linear Equation 


Matrix Inversion Method: Let A" be the inverse ofthe matrix A defined by, 


VERMES A 
z VT (4.5) NOTES 


where Adj A is the adjoint matrix obtained by transposing the matrix ofthe cofactors 
ofthe elements a; of the determinant of the coefficient matrix A. 


Thus, 
Ai Seu Án 
Adj 4-| ^ Aya By 
A, Aue A, 
(4.6) 
A, being the cofactor of a, 
Then the solution ofthe system is given by, 
xm 
(4.7) 


Note: If the rank of the coefficient matrix of a system of linear equations in n 
unknowns is less than n, then there are more unknowns than the number of 
independent equations. In such a case, the system has an infinite set of solutions. 


Example 2: Solve the given system of equations by matrix inversion method: 


3: 2 afla Wa 


Solution: For solving the system of equations by matrix inversion method we first 
compute the determinant ofthe coefficient matrix, 
TR VEE | 
|Al=|2 -1 3ļ=13 
3 2 =l 
Since | 4| # 0, the matrix A is non-singular and A! exists. We now compute 
the adjoint matrix, 


-5 3 4 waal a 
AdjA=|11 -4 -1|. Thus, une c -|11 -4 o 
|4| B 
7 1 -3 7 1 -3 
Hence, the solution by matrix inversion method gives, 
x, 5 us. cw -13] [-1 
x=|x, |=4'b=—|11 -4 -1 1 }=—] 39 |=| 3 
13 13 
X3 7 E ^e3 1 26 Self-Instructional 
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Solution of Simultaneous Gaussian Elimination Method: This method consists in systematic elimination 
Linear Equation : AC . 
ofthe unknowns so as to reduce the coefficient matrix into an upper triangular 
system, which is then solved by the procedure of back-substitution. To understand 
the procedure for a system ofthree equations in three unknowns, consider the 


NOTES following system of equations: 
Ay 1X1 t d15X5 * d43X4 =, (4.8(a)) 
dt; dedo db oed (4.8(b)) 
a, Xi + 045X, * d44X4 = b, (4.8(c)) 


We have to first eliminate x, from the last two equations and then eliminate x, 
from the last equation. 


In order to eliminate x, from the second equation we multiply the Equation 
(4.8(a)) by- a;, /a,, =m,, and add to the second equation. Similarly, for elimination 
of x, from the third Equation (4.8(c)) we have to multiply the first Equation (4.8(a)) 
by -a,,/a,, =m, , and add to the last Equation (4.8(c)). We would then have the 
following two equations from them: 


1 1 1 

aQ X5 aU x, Du (4.9(a)) 
1 1 1 

a) ss edd my e 


(4.9(b)) 
D D D. 
where dj, 245 — MQ), us = 05, — 503, bj = b, —m,b, 


ay) = d3 — MQ), as, = 43 — ma, by” =b, — mb, 
Again for eliminating x, from the last of the above two equations, we multiply 
the first Equation (4.9(a)) by m, =a‘) /a{}, and add to the second Equation 


22? 


(4.9(b)), which would give the equation, 
aP =p (4.10) 


where a® - aO —m,a®, bP =b —m,b® 


Thus by systematic elimination we get the triangular system given below, 


GuX; + d15X» + d13X3 =b; (4.11(a)) 
aS x, - ax, =b (4.11(b)) 
aC) x, = p? (4.11(c)) 


Itis now easy to solve the unknowns by back-substitution as stated below: 


We solve for x, from Equation (4.11 (c)), then solve for x, from Equation 
(4.11(b)) and finally solve for x, from Equation (4.11 (a)). This systematic Gaussian 
elimination procedure can be written in matrix notation in a compact form, as 


shown below. 
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(7) We write the augmented matrix, [A : b] and the multipliers on the left. 


Perform row operators 


R,—m,R, and R, —m,R, 


m, =—A,,/a,, dy Ay d b. 


m, =—a;,/a,, da As a; b, 


(ii) Then we write the transformed 2nd and 3rd rows after the elimination of x, by 
row operations [(m, x 1st row + 2nd row) and (m, x Ist row + 3rd row)] as 
new 2nd and 3rd rows along with the multiplier on the left. 


d, d, dy b 
o0 4(0 , 4,0 a) (1) (1) Perf 
m, — —d3, / d dy X by PORE 
a) (1) (1) ES 
dy, du b R,—-m,R, 


(iii) Finally, we get the upper triangular transformed augmented matrix as given 


below. 
d, a. Az, b 
1 1 1 
as) ag by (4.12) 
2 
dy b, 
Notes: 


1. The above procedure can be easily extended to a system of n unknowns, in 
which case, we have to perform a total of (n—1) steps for the systematic 
elimination to get the final upper triangular matrix. 

2. Thecondition to be satisfied for using this elimination is that the first diagonal 
elements at each step must not be zero. These diagonal elements 


[a aC), al}, etc] are called pivot. If the pivotis zero at any stage, the method 


fails. However, we can rearrange the rows so that none of the pivots is zero, 
at any stage. 


Example 3: Solve the following system by Gauss elimination method: 
x +2x, +x, =0 
2x, + 2x, +3x, =3 
=x —3x, =2 
Show the computations by augmented matrix representation. 
Solution: The augmented matrix of the system is, 


1 2 1: 0 
2- 2 R3 
-1 -3 0:2 
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Mrd of CIIM Step 1: For elimination of x, from the 2nd and 3rd equations we multiply the first 
pooner erates equation by 2 and 1 successively and add them to the 2nd and 3rd equation. The 
result is shown in the augmented matrix below. 


NOTES 1 2 1: 0 
-2 |0 -2 1: 3 


1/0 -1 1: 2 
Step 2: For elimination of x, from the third equation we multiply the second 
: 1 2 : ; : : 
equation by - 3 and add it to the third equation. The result is shown in the augmented 
matrix below. 


1 2 1 : 0 
-1/20 -2 1 : 3 
0 0 1/2 : 1/2 


Step 3: The upper triangular system is now solved by back-substitution, giving 


Acc x x1 


Gauss-Jordan Elimination Method: The Gauss-Jordan elimination method is 
a variation ofthe Gaussian elimination method. In this method, the augmented 
coefficient matrix is transformed by row operations such that the coefficient matrix 
reduces to the identity matrix. The solution ofthe system is then directly obtained 
as thereduced augmented column ofthe transformed augmented matrix. We explain 
the method with a system of three equations given by, 


Qj an 4] !|X bi 
dj an az || X | =| By 
a31 432 033 || X3 b, 
(4.13) 
The augmented matrix is, 
fiy 01 45 b, 
4j 05 053 b, 
43, Gyn 034 b, 
(4.14) 


We assume that a,, is non-zero. If, however, a,, is Zero, we can interchange 
rows so that a,, is non-zero in the resulting system. 


The first step is to divide the first row by a,, and then eliminating x, from 2nd 
and 3rd equations by row operations of multiplying the reduced first row by a,, 
and subtracting from the second row and next multiplying the reduced first row by 
a,, and subtracting from the third row. This is shown in matrix transformations 
given below. 
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, , [1 , , 

4, 4 ag b, 1 a, ay b, R-Ra 1 ay, ay bj 

=? ! = Jal ' ! ' 

aa Ay 5 b, Ria aa Ay Ag, b, R.-R 0 ay a, b; 
1/ 05 -R ay, 

b. a, a, d, b. 0a, a b; 

43, 05 l3 5 31.053. 03 5 32 83 5 


, — , i P 
aj = yp /dy, 45 7d Idi, b - bla, 
P oem =. [ Ages i f fe, » [ 
d, = d, dy dj, d54 = d, 705 dj, b, = b, - ab 


, , , , , , 
d, = dy, — 31 dj), 33 = Az, 7 3, dj, b3 = b, — abi 


Now considering a}, as the non-zero pivot, we first divide the second row by 
a5, and then multiply the reduced second row by aj, and subtract it from the first 


row and also multiply the reduced second row by a}, and subtracting it from the 
third row. The operations are shown below in matrix notation. 


| ay a; : b Ay |l à, ag bi R-R.a', md R-R, ad! 102a; : B 
0 a, a, : M|——2—0 1 a4: Bw — —3 5,0 1 af, : 5 
Qa an vob 0 a, ah : b 00a, : b 
where 


| el a " "n h_a p" 

aj = 443 — di) A535 b = bj - apb 
n 

a 


e ruf [ "m n [ 
23 = 493 / ay, by = by la, 


22° 
d ás 


"Ė " [ "oH 4 nt 
Q5, = d3, 05, dy, b3 = b, —a4,b5 


Finally, the third row elements are divided by a5, and then the reduced third 
row is multiplied by aj, and subtracted from the first row and also the reduced 
third row is multiplied by a5, and subtracted from the second row. This is again 
shown in matrix notation below. 


10a: b 102: E 100: M 
0 1 ano: bẹ 1 ao:M| 2 0120:H 

a » 3/ 035 " R -a".R : 
0 0 a5 b; 00 1] : 5 27 05315 0 0 1 b; 


where b/ 2 b'—a'jb! , bY =b! -atb b! - blat 
Finally, the solution ofthe system is given by the reduce augmented column, 
i.e., x, =b” x, =b?” and x, =b” 


We illustrate the elimination procedure with an example using augmented matrix, 


18 
13 


2 
1 
3 14 


— WN 
Ww N A 
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First, we divide the first row by 2 then subtract the reduced first row from 2nd 
row and also multiply the first row by 2 and then subtract from the third. The 
results are shown below: 


12 X38 as qp seri ghee. d, dem oum 
i dox $E 24:45 — >lo 2 0: 4 
3 1 3 14 3 1 3 : 14| R+2R |0 -2 -3 : -13 


Next considering 2nd row, we reduce the second column to [0, 1, 0] by row 
operations shown below: 


fa 2: 9 Eir Be dTig due eg 
02 0: 4/229 1 o0: 2|——2101 0:2 
0 -2 -3 : -13 0 -2 -3 : -13| dete |o 0 -3 : -9 


Finally, dividing the third row by —3 and then subtracting from the first row the 
elements ofthe third row multiplied by 2, the result is Shown below: 


10 2 pr EI MT NE LIE 
01 0 2 UNE e eee qd 
0 0 -3 : -9 001:3 001:3 


Hence the solution of the system is x, = 1, x, = 2, x, =3. 


Example 4: Solvethe following system by Gauss-Jordan elimination method: 


3 18 9][x] [18 
2.3 3||x, 1217 
4 1 2||x| | 283 


Solution: We consider the augmented matrix and solve the system by Gauss- 
Jordan elimination method. The computations are shown in compact matrix notation 
as given below. The augmented matrix is, 


3 18 9 : 18 
2 3 3: 117 
4 1 2 283 


Step 1: The pivot is 3 in the first column. The first column is transformed into [1, 
0, 0]' by row operations shown below: 


3 18 9 : 18 163 6 1 6 3 : 6 
R,/3 R,-2R 

2.3 3: 17|——|2 3 3 117 >]0 -9 -3 : 105 

4 1 2: 283 412 293} 575 |o -23 -10 : 259 


Step 2: The second column is transformed into [0, 1, 0] by row operations shown 
below: 


1 6 3: 6 1 6 3: 6 10 1 : % 
-R,/9 R, -6R, 
0 -9 -3 : 105|————5|0 1 1/3 : -35/3 —— 2—9]|0 1 1/3: -35/3 
0 -23 -10 : 259 0 -23 -10 : 259 j 0 0 -7/3 : 28/3 


Step 3: The third column is transformed into [0 0 1]' by row operations shown 
below: 


10 1 : 76 10 1: 76 100: 72 
R,ICTIS) R,-R; 

0 1 1/3 : -35/3 0 1 1/3 : -35/3|—1—32— 9 1 0 : -13 

0 0 -7/3 : 28/3 00 1 : 4 | RBj-R/3|0 0 1 4 


Hence the solution of the system is x, = 72, x, — —13, x, = 4. 


4.2.3 Iterative Methods 


We can use iteration methods to solve a system of linear equations when the 
coefficient matrix is diagonally dominant. This is ensured by the set of sufficient 


conditions given as follows, 


Y ay|«|ag| for i2L2,..n (4.15) 


j=l, j*i 
An alternative set of sufficient conditions is, 


n 


Say < lag, for j=1, 2,7 (4.16) 


i=l, i+ j 


There are two forms of iteration methods termed as Jacobi iteration method 
and Gauss-Seidel iteration method. 


Jacobi Iteration Method: Consider a system ofn linear equations, 


Ay, X + dj, X) * dq, X3 t ess *ta,x,-b 

Ay, X, + Ay, X) t 4 X Horine +a, X, =b, 
Ay XV Ay X) ay XS uses +43, X, =, 
id E XS FU SY aeos ta X, 7b 


The diagonal elements a,, i= 1, 2, ..., n are non-zero and satisfy the set of 
sufficient conditions stated earlier. When the system of equations do not satisfy 
these conditions, we may rearrange the system in such a way that the conditions 
hold. 


In order to apply the iteration we rewrite the equations in the following form: 


Solution of Simultaneous 
Linear Equation 


NOTES 


Self-Instructional 
Material 


75 


Solution of Simultaneous 
Linear Equation 


NOTES 


Self-Instructional 
76 Material 


x, 7 (b, -d,5X5 — 443%, i, X, )/ di 

xX, = (bj — Gy) 7 453%; Ay, X,)/ Ay 

X, = (b - 43X] 7 055X5 ds, X, )/ 33 

xn = (b, an 0*5 t a unl Xn)! d, 


To start the iteration we make an initial guess of the unknowns as 
xO, xO, 0... (initial guess may be taken to be zero). 


"m 


Successive approximations are computed using the equations, 


(k+l) _ (k) (k) (k) 
xi = (b =a X3 ag Xj Ay, X, )/ a 
(k+1) (k) (k) (k) 
Xj = (By — Ag, Xj Tay Xy Saan X, )/ dy 
(k+l) (k) (k) (k) 
X;  —(b,-a4 X( ay X5 —..—d4, X, )/da, 
n A (4.17) 
(k+l) _ (k) (k) (k) 
Xa z (b, —COap XQ Tyg X) eTA i Xn)! Any 


where k= 0, 1,2, ... 
The iterations are continued till the desired accuracy is achieved. This is checked 
by the relations, 


xt) Ly eg, for i=l, 2,...,n (4.18) 


Jacobi Iterative Algorithm 


Choose an initial guess x to the solution x. 


for k— 1,2, ... 
fori—-1,2,...,n 
x,-0 
forj-1,2,..,i—l,;itl,..,m 
Boe Paper” 
end 
%=(,-%)/a,, 
end 
yu 


check convergence; continue if necessary 


end 


Gauss-Seidel Iteration Method: This is a simple modification ofthe Jacobi 
iteration. In this method, at any stage of iteration ofthe system, the improved 
values ofthe unknowns are used for computing the components ofthe unknown 
vector. The iteration equations given below are used in this method, 


k+l k k k 
xí *D - (b, —a,, x9 a x - ecd x ya. 
k+l k+l k k 
3 s (b, -a, v Da x )-2-a,, y ya 
(k+1) (eH) (eH) (k) 
X. 4D edu X Reh, te ae Xy )/ a33 (4.19) 


x) 2b —a x) -a x (k +1) -...-4,, 


2 
n nl x, an2 )/a, 


It is clear from above that for computing x"), the E value of x(**) 
is used instead of x/?; and for computing x(^*", the improved values x(**” and 
x) areused. Finally, for computing x“? , improved values of all the components 


(k+1) (k+l) 
Xp Neg ven 


continued till the desired accuracy 1s achieved. 


x^? are used. Further, as in the Jacobi iteration, the iterations are 
Example 5: Solve the following system by Gauss-Seidel iterative method correct 
upto four significant digits. 


10x, -2x, 


-2x +10x, =x, =x; =15 


=x, = X4 =3 


=x =x, +10x, -2x, = 27 


=x =x, —2x,+10x, = -9 


Solution: The given system is clearly having diagonally dominant coefficient matrix, 


n 
L.e., la;| = Sila, |, 


j=l 
Hence, we can employ Gauss-Seidel iteration method, for which we rewrite 
the system as, 
x) = 0,340.22 4 0.1 x(P +0.1 x 
x) 21,54 02 x(*9 0.1 x09 +012 
xD 227: 0.x? 40.1 xt 4:03 309 
x) = 9.9. 0.1x(D 4.9.1 x 40.2 xf? 


We start the iteration with, 


D =0.3, xP =1.5, x® E07 xP 00 
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The results of successive iterations are given in the table below. 


k XI X2 X3 X4 
1 0.72 1.824 2.774 —0.0196 
2 0.9403 1.9635 2.9864 —0.0125 
3 0.09901 1.9954 2.9960 —0.0023 
4 0.9984 1.9990 2.9993 —0.0004 
5 0.9997 1.9998 2.9998 —0.0003 
6 0.9998 1.9998 2.9998 —0.0003 
T 1.0000 2.0000 3.0000 0.0000 


Hence the solution correct to four significant figures is x, — 1.0000, x, — 
2.000, x, — 3.000, x, — 0.000. 


Example 6: Solve the following system by Gauss-Seidel iteration method. 
20x, c 2x, +x, =30 
x, - 40x, +3x, = —75 


2x, — x, +10x, 230 


Give the solution correct upto three significant figures. 


Solution: It is evident that the coefficient matrix is diagonally dominant and the 
sufficient conditions for convergence ofthe Gauss-Seidel iterations are satisfied, 
since 

[a,| 220 2 |a | |a] 23 

|a,,|=40 2 |a,,|+|a,,|=4 

|a,,|=10 = |a,,|+]a,,|=3 


For starting the iterations, we rewrite the equations as, 
1 
x, = rae 2x,—x4) 
1 
xX, = ape T3x.) 
1 
xX, = quee TX) 
The initial approximate solution is taken as, 


x® =1.5, a =2.0, ag 


The first iteration gives, 


1 
x (30-2x2.0—3.0) 2 1.15 
20 
a _ 1 E 
xp = qg 511583330) - 2.14 


xP = E 0072x145 2.14) = 2.98 


The second iteration gives, 


x? = 55 00-2x2.14- 2.98) =1.137 


1 


xm gp 051137 +3%2.98) =2.127 


ae = = (30-2%1.137+2.127) = 2.986 
The third iteration gives, 

Chad 

xi = 5p 00-2x2.127 - 2.986) = 1.138 

o. I 

A = Gp 5*1.13843x2.986) = 2.127 


ae E G0-2x1.138+2.127) = 2.985 
Thus the solution correct to three significant digits can be written as x, = 1.14, 
x, = 2.13, x, = 2.98. 


Example 7: Solve the following system correct to three significant digits, using 
Jacobi iteration method. 


10x, +8x, 3x, +x 


3x, - 4x, +10x, +x 
2x, +10x, +x, -4x, =9 
2x, +2x, —3x,+10x, =11 
Solution: The system is first rearranged so that the coefficient matrix is diagonally 
dominant. The equations are rewritten for starting Jacobi iteration as, 
x 216-0. x 40.3 x9?-01 x? 
x) 99-02 x?401 2-04 xP 
x) =1.0-03 x9 404 x9-01 xP 


x^"-211-02 x?.02 x-03 x, where k-0, 1, 2,.. 


The initial guess of solution is taken as, 
Xp =1.6, xP =0.9, xP =1.0, xP =1.1 


The results of successive iterations computed by Jacobi iterations are given in 
the following table: 


X1 Xa X3 X4 
1.07 0.92 0.77 0.90 
1.050 0.969 0.957 0.933 
1.0186 0.9765 0.9928 0.9923 
1.0174 0.9939 0.9858 0.9989 
0.9997 0.9975 0.9925 0.9974 
1.0001 0.9997 0.9994 0.9984 
1.0002 0.9998 1.0001 0.9999 


-dOoO tn 2 UCbF.2-—|2 
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Solution of Simultaneous Thus the solution correct to three significant digits is x, = 1.000, x, = 1.000, 
Linear Equation 


x, — 1.000. 
Algorithm: Solution ofa system of equations by Gauss-Seidel iteration method. 
NOTES Step 1: = elements a of augmented matrix for i= 1 to n, next, 1 ton 
t]. 


Step 2: Input epsilon, maxit [epsilon is desired accuracy, maxit is maximum 
number of iterations] 

Step 3: Set x, — 0, for i= 1 to n 

Step 4: Set big = 0, sum = 0, j = 1, k= 1, iter = 0 

Step 5: Check if k + j, set sum = sum + ds X, 

Step 6: Check if k <n, set k= k * 1, go to Step 5 else go to next step 

Step 7: Compute temp = (a, 


n+ 8um)/a, 

Step 8: Compute relerr = abs (x, — temp) / temp 

Step 9: Check if big < relerr then big = relerr 

Step 10: Set x, = temp 

Step 11: Setj=j+1,k=1 

Step 12: Check if j <n to Step 5 else go to next step 

Step 13: Check ifrelerr « epsilon then {write iterations converge, and write 
x, for j=1ton goto Step 15} else if iter < maxit iter = iter + 1 go 
to Step 5 

Step 14: Write ‘iterations do not converge in’, maxit ‘iteration’ 

Step 15: Write x, forj=1 ton 

Step 16: End 


4.2.4 Computation of the Inverse of a Matrix by using Gaussian 
Elimination Method 
The inverse matrix B ofa given square matrix A satisfy the relation, 
A.B-I 
where Zis the unit matrix of the same order as that of A. In order to determine the 
elements b, of the matrix B, we can employ row operations as in Gaussian 


elimination. We explain the method for a 2 x 3 matrix as given below. We can 
write the above relation in detail as, 


à dip 43)) 41 b bi 100 
dj an dy||Dby b b5|-(0 1 0 
di a32 435 || bj b32 b33 0 0 d 
By using the definition of matrix multiplication we can write that the above 
relation equivalent to the following three systems of linear equations. 


ai dij. ag || by 1 dy 4p a3 || b2 0 a, Ay 43 [Djs 0 
Ay, an Ay3} | bn, =| 9], |a an az |] Bon |=] 1], |an an az | | 3 | =] 0 
Self-Instructional 43, az 433 || bz O} [a31 az 435 | | 530 O| ds; 435. 033 | | b33 1 
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Thus by solving each ofthe above systems we shall get the three columns of 
the inverse matrix B= A. Since, the coefficient matrix is the same for each of the 
three systems, we can apply Gauss elimination to all the three systems 


simultaneously. We consider for this the following augmented matrix: 
NOTES 


Q4 d a3: 10 0 
dj ay az: 0 1 0 
43, 43, 33: 0 0 1 
We employ Gauss elimination to this augmented matrix. At the end of Ist 
stage we get, 


R,-(an/ 441) R, Qj 05 3 l 0 0 
SE LEN Q 40 . 
0 a, a4 : -a4,/a, 1 O 
R,—-(a4,/a, )R OQ 40 . 
3 ( 31 u) 1 0 a a4 : -a4/a, 0 1 
where 
(Q) _ (1) _ = 
yy 745, - (a5, /a))055, 45 =a = (491/41) 3 
(1) _ () _ = 
d3, 743, = (43, — 5,)0j,, 433 = 433 — (43,41) 3 
Similarly, at the end of the second stage, we have 
a 4 4, : 1 Q 
Q) j 40 Y 4O Q 40 . 
R, - (a$ / d, ) 3 >| 0 ay ay 2 cy, l 
D. 
0 0 ay 3 cy, c4, 1l 
where 
D 40 (Qj 0) ( = 
Q3 = 03 — (a / d, ) d», Cy, ——(a5/ ap) 


= (1) (1) = (D) j 0) 
z (an 055 /dy an )- (a/a), C39 - -(a$ / dy, ) 


By back-substitution process, we get the elements ofthe inverse matrix, by 
solving the three systems corresponding to the three columns of the reduced 
augmented part, i.e., 


1 0 0 
cy, 1 0 
C31 C5 1l 


We illustrate the method by an example given below. 
Example 8: Find the inverse ofthe following matrix A by Gaussian elimination 


method. 


A S 
A=|4 4 -3 
E. EE 


Solution: We consider the following augmented matrix: 
2 3 -21:100 

[4]]-|4 4 -3:010 

2 -3 1:001 
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Using Gaussian elimination to this augmented matrix, we get the following at 
the end of first step: 


R -2R 2 3 -1:1 00 
———2 |0 -2 -1:-2 1 0 
R,-R 0 -6 2 :-1 0 1 


Similarly, at the end of 2nd step we get, 
2 3 -1:1 0 0 
»0 -2 -1:-2 1 0 
0 0 5:5 -3 1 
Thus, we get the three columns of inverse matrix by solving the following three 
systems: 


R,-3R, 


2 3 -1: TI[2 3 -1: o][2- 3 -1:0 
20-2 -1 : 1]|/0 -2 -1: 0 
0 o0 5: 59708. 5 :-3|l0 0 5:1 
The solution ofthe three are easily derived by back-substitution, which give 
the three columns ofthe inverse matrix given below: 
1/4 0 1/4 
1/2 -1/5 -1/10 
1 -3/5 1/5 
We can also employ Gauss-Jordan elimination to compute the inverse matrix. 
This is illustrated by the following example: 
Example 9: Compute the inverse of the following matrix by Gauss-Jordan 
elimination. 


ps 53-124) 
A=|4 4 -3 
ee i] 


Solution: We consider the augmented matrix [A : /], 


2 3 1:100 1 3/2 -1/2 :1/2 0 0 
[4:1]o 4 -3:0 1 0—4 4 3:0 10 

F 238 "qo e 2" 2 3 1 :0 01 
nom [| 3/2 -1/2 :12 0 0 1 3/2 -1/2 :1/2 0 0 
Z 1 
— 72310 2 -1 :-2 1 0|l——4|0 1 4/2 : 1 -J/2 0 
R,-4R R,/-2 
2775 10 -6 2 :-1 01 0 6 2 :-1 0 1 


R-3R/2 [| 9 -5/4 :-1 3/4 0 1 0 -5/4 :-1 3/4 0 
——— 7]0 1 1/2 :1 -1/2 0À——z290 1 1/2 :1 -1/2 0 
00 1 :1 -3/5 1/5 


RasRjA || 0 0 :1/4 0 1/4 
———— Up dec AO 
R,-1R;,/2 y 1 : 1 -3/5 1/5 


1/4 0 1/4 
which gives 4! =|1/2 -1/5 -1/10 
1 -3/5 1/5 


Un BW l2 — 


. When is the system of equation homogenous and when non-homogenous? 
. Explain Gauss elimination method. 

. Explain Gauss-Jordan elimination method. 

. Whyare iterative methods used? 

. Explain Gauss-Seidel iteration method. 


Check Your Progress 


4.4 


ANSWERS TO ‘CHECK YOUR PROGRESS’ 


. The system of equations Ax = b is termed as a homogeneous one if all the 


elements in the column vector b are zero. Otherwise, the system is termed 
as anon-homogeneous one. 


. The gauss elemination method consists in systematic elimination of the 


unknowns so as to reduce the coefficient matrix into an upper triangular 
system, which is then solved by the procedure of back-substitution. 


. The Gauss-Jordan elimination method is a variation of the Gaussian elimination 


method. In this method, the augmented coefficient matrix is transformed by 
row operations such that the coefficient matrix reduces to the Identity matrix. 
The solution of the system is then directly obtained as the reduced augmented 
column of the transformed augmented matrix. 


. Wecan use iteration methods to solve a system of linear equations when 


the coefficient matrix is diagonally dominant. 


. The Gauss-Seidel iteration is a simple modification of the Jacobi iteration. 


In this method, at any stage of iteration of the system, the improved values 
of the unknowns are used for computing the components of the unknown 
vector. 


SUMMARY 


Many engineering and scientific problems require the solution of a system 
of linear equations. 

The system of equations is termed as a homogeneous one ifall the elements 
in the column vector b of the equation Ax = b, are zero. 

Cramer’s rule and matrix inversion method are two classical methods to 
solve the system of equations. 

If D = |A| be the determinant of the coefficient matrix A and D, is the 
determinant obtained by replacing the ith column of D by the column vector 
b, then the Cramer's rule gives the solution vector x by the equations, 


x=! for i= 1,2 
i D OFFA by Sp cui 5 Ml. 
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4.6 


e Gaussian elimination method consists in systematic elimination of the 
unknowns so as to reduce the coefficient matrix into an upper triangular 
system, which is then solved by the procedure of back-substitution. 


In Gauss-Jordan elimination, the augmented matrix is transformed by row 
operations such that the coefficient matrix reduces to the identity matrix. 


We can use iteration methods to solve a system of linear equations when 
the coefficient matrix is diagonally dominant. 


There are two forms of iteration methods termed as Jacobi iteration method 
and Gauss-Seidel iteration method. 


Gaussian elimination can be used to compute the inverse of a matrix. 


KEY WORDS 


Homogenous equation: In this system of equations, all the elements in the 
column vector b of the equation Ax = b, are zero. 


Gaussian elimination: It is the systematic elimination ofthe unknowns so 
as to reduce the coefficient matrix into an upper triangular system, which is 
then solved by the procedure of back-substitution. 


Gauss-Seidel iteration: In this method, at any stage of iteration ofthe 
system, the improved values ofthe unknowns are used for computing the 
components ofthe unknown vector. 


SELF ASSESSMENT QUESTIONS AND 
EXERCISES 


Short-Answer Questions 


1. Define the system of linear equations. 


2. How many determinants d, we have to compute in Cramer’s rule? 


3. What is the basic difference between Gaussian elimination and Gauss-Jordan 


elimination method? 


4. What are iterative methods? 


5. State an application of Gaussian elimination method. 


Long-Answer Questions 


1. Use Cramer’s rule to solve the following systems of equations: 
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Ox xa xa (i) x +x, tx, = 6 
2x = 3x, tx = d x t 2x, + 3x, = 14 
3x +x, QUE PRESA ot ee 2 


2. Using the matrix inversion method to solve the following systems ofequation: Solution A Sim P 
inear Equation 


(i) 4x, x, + 2x, = 15 (ii) x, 4x, + 9x, = 16 
4512.34. v5 2x, tx, x, — I0 
5x, — 7x, + 9x, = 8 3x, + 2x, + 3x, = 18 NOTES 


3. Solve the following systems of equation using Gaussian elimination method: 


(i) 2x + 2y + 4z=18 (ii) x, + 2x, +x, 4x, = 13 
x+ 3y+2x=13 x, t 4x, + 3x, = 28 
3x + y+ 3x = 14 4x, 2x, + 2X7 x, = 20 


—3x, +x, + 3x, + 2x,=6 


4. Apply Gauss-Jordan elimination method to solve the following systems: 


(D x, t 2x, + 3x, = 4 (ii) 5x t 3x, + x, = 2 
Xa SP m3 4x, + 10x, + 4x, = -4 
2X cb 2. ry c 2x, + 3x, + 5x, = 11 


5. Compute the solution ofthe following systems correct to three significant 
digits using Gauss-Jordan iteration method: 


(©) 9x = 3x, + 2x, = 23 (ii) x, + 2x, + 3x, + 4x, = 30 
6x, + 3x, + 14x, = 38 4x t x, 2x, + 3x, = 24 
4x, t 2x, — 3x, = 35 3x, + 4x, t x, + 2x, = 22 

2x, + 3x, + Ax, + x, = 24 
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BLOCK - II 
EIGEN VECTORS, INTERPOLATION, 
APPROXIMATION, DIFFERENTIATION 
AND INTEGRATION 


UNIT5 EIGEN VALUES AND 
EIGEN VECTORS 


Structure 
5.0 Introduction 
5.1 Objectives 
5.2 Finding Eigen Values and Eigen Vectors 
5.3 Jacobi and Power Methods 
5.4 Answers to Check Your Progress Questions 
5.5 Summary 
5.6 Key Words 
5.7 Self Assessment Questions and Exercises 
5.8 Further Readings 


S.0 INTRODUCTION 


In linear algebra, an eigenvector or characteristic vector ofa linear transformation is 
a nonzero vector that changes at most by a scalar factor when that linear 
transformation is applied to it. The corresponding eigenvalue is the factor by which 
the eigenvector is scaled. Geometrically, an eigenvector, corresponding to 
a real nonzero eigenvalue, points in a direction in which it is stretched by the 
transformation and the eigenvalue is the factor by which it is stretched. If the 
eigenvalue is negative, the direction is reversed. Loosely speaking, in a 
multidimensional vector space, the eigenvector is not rotated. However, in a one- 
dimensional vector space, the concept of rotation is meaningless. 


In this unit, you will study about the Eigen values, Eigen vectors and Jacobi 
power method. 


5.1 OBJECTIVES 


After going through this unit, you will be able to: 
e Understand the concept of Eigen values and Eigen vectors 


e Analyse the Jacobi and power methods 


Eigen Values and 


5.2 FINDING EIGEN VALUES AND EIGEN Eigen Vectors 


VECTORS 
Let A = [a] be a square matrix of order n. If there exists a non-zero (non-null) NOTES 
column vector X and a scalar / such that, 
AX =KX 


Then A is called an eigenvalue ofthe matrix A and X is called eigenvectors 
corresponding to the eigenvalue A. 


The problem of finding the values of the parameter A, for which the 
homogeneous system, 


AX -ÀX (5.1) 


possesses non-trivial solution is known as characteristic value problem or 
eigenvalue problem. 


Thus, system of Equation (5.1) possesses non-trivial solution if and only if, 
[A4-A]] =0 29:2) 
This Equation is known as the characteristic equation ofthe matrix A. 


The roots of this Equation (5.2) are called latent roots or characterstics 
values or eigenvalues ofthe matrix A. The corresponding non-trivial solutions are 
called eigenvectors or characteristic vectors of A. 


If A is an n x n matrix, then its characteristic equation is an nth degree 
polynomial equations in A. Therefore, an n x n matrix has n eigenvalues (real or 
complex). 


Suppose A; (i= 1,2, 3, ... ., n) be the eigenvalues of A, then for each À, 
there exists a non-null vector X; such that 


AX, — A, X, (51,23. 5. n) 
Multiplying both sides by a non-zero scalar k, we get 
A(KX) — —A (kX) 


This implies that an eigenvector is determined upto a multiplicative scalar. In 
other words, the eigenvector is not unique. But corresponding to an eigenvector 
ofthe matrix A, there can be one and only one eigenvalue of the matrix A. 


It can be shown that for a matrix A of order n, the characteristic Equation 
(5.2) can be written as, 


AJ -pa*!- BA”? +......+ C1)” B,-0 
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Eigen Values and Where D, is the sum ofall the determinants formed from square matrices of 
Eigen Vectors MO 2 ; Sees : 
order r whose principal diagonals lie along the principal diagonal of A. 


Notes: 
NOTES 1. Aneigenvector ofa matrix cannot correspond to two different eigenvalues. 


2. Aneigenvalue ofa matrix can, and will correspond to different eigenvectors. 


3 4 
Example 1: Find the eigenvalues and eigenvectors of A = | F E 


- oos eec 4 
Solution: The characteristic equation is | " J | =0 


V-25=0 > X- £5 
The eigenvectors are given by AX — A.X 
i.e., (A-ADX=0 


Pe aas] 


If, À —5, 
We get, — 2x, + 4x, =0 
4x, — 8x, =0 

Or. A = 
5 2 1 


; . |2 
— The eigenvector is H 


If  —-—5, we get: 8x, + 4x, = 0 


4x, "E 235 zm 0 
2X = xX, 
E S 
-1 2 


.. The eigenvector is E] 


Self-Instructional 
88 Material 


2 Eigen Values and 
The eigenvalues are 5 and —5 with the corresponding eigenvectors are H and igen Vectors 


-1 ; 
E] respectively. NOTES 


3 -4 4 
Example 2: Find the eigenvalues and eigenvectors ofthe matrix |1 -2 4 
1 -1 3 


à 4 4 
Solution: Let 4=|1 -2 4 
1 -1 3 


The characteristic equation is |A —A/|=0 


3-X. beo 4 


(3 - )[C2 -A)(3 — GA) + 4] + 4(3 4-4) c 41-2 3) 20 
AAA + 6 =0 


The eigenvalues are the roots of this equation and they are —1, 2, 3. 
The eigenvectors are given by the solution of: 


(4 - AX - 0 


Do 3-AJ/x 
(3 = Ay, — 4x, T 4x3 = 0 
X1 = (2 + Ay, DE 4x4 = 0 
X,-X,+(3-A)x, = 0 


Case 1: À—-1 gives: 
4x, — 4x, + 4x; = 0, x, —x, + 4x, = 0, x, — x, + 4x, = 0 


Solving the first and second equations by the method of cross multiplication we 
get: 
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Eigen Values and 


Eigen Vectors -12 1 
-. The eigenvector is X, =|-12| or} 1 
0 0 

NOTES 


Case 2: A=2 gives: 


X, — 4x + 4x; = 0, x, — 4x + 4x3 = 0, x, x, + x3 = 0 
Solving the first and third equations we get the eigenvector X, = | 1 


Case 3: A=3 gives: 
— 4x, + 4x, = 0, x, — 5x, + 4x, = 0, x, —x, = 0 


Solving any two of these equations we get the eigenvector X; = | 1 


Note: For a square matrix A = (a;;) of order 3, the characteristic equation |4 — AJ] 
= 0, takes the form: 


A - B^ + B.A — B, = 0 
Where, B, =a, + a> + a33 = Sum of the leading diagonal elements of A 


a, 05 


= Sum of the minors ofthe leading diagonal elements of A 


8;=|A |= Determinant ofthe matrix A 


In the Example 2 
B, =3-2+3=4 
-2 4 3 4 3 -4 
&-h eh ath alos hr 


.. The characteristic equation is A^ 47 +A +6=0 


Note: If à is an eigenvalue of matrix A of order 3, then the components of the 
eigenvector of matrix A corresponding of À are proportional to the cofactors of 
the elements of any row of |4 — AJ] provided that not all of them vanish. 


This method is used for the computation of the eigenvectors in the following 


examples. 
2 2 0 
Example 3: Find the eigenvalues and eigenvectors of the matrix | 2 1 1 
-7 2 -3 
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Solution: The characteristic equation is, bus d and 
igen Vectors 
A - B.A’ + B. — p, = 0, 
Where, Bj21 2-370, p, =-5-6-2=- 13, B,=- 12 


c" Boa NOTES 
The characteristic equation is, 


1-131412 =0 
(A—1)(A+4)(A-3) =0 


The eigenvalues are 1, —4, 3, when 


12 0 
À-21,4—-ÀI2]2 0 1 
SIC d 


Components ofthe eigenvectors are proportional to the cofactors ofthe elements 
of the first row, namely —2, 1, 4. 


=2 
-. The eigenvector is | | 
4 

-] 2 0 

WhenA-3,4-A1-|2 -2 1 

-7 2 -6 


The cofactors of the elements ofthe first row are 10, 5, 110, which are proportional 
to 2, 1, 2 respectively. 
2 


Theeigenvectoris | 1 
=2 


6 2 0 
When A=-4,4-AJ=|2 5 1 
2.4 
The cofactors ofthe elements ofthe first row are 3, —9, 39, which are proportional 


to 1, 23, 13 respectively. 


l 
The eigenvector is | -3 
13 
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Eigen Values and 
Eigen Vectors 


1 6 1 
Example 4: Find the eigenvalues and eigenvectorsof 4— |! 2 0 
0 0 3 


NOTES Solution: The characteristic equation is A? — B,A* + B-A- p, — 0 


Where, B, = 1+2+3=6 


age 2-0] ro ee 
^ los|[|os3] [1 2 
= 6+3+2-6=5 


B, = |A| = 1(6) - 6(3) + 1(10) 2 -12 
The characteristic equation is A^ —6A? + 5A + 12=0 


The roots of this equation —1, 3, 4 are the eigenvalues of A, when 
2 6 1 
A--1lA4-ÀI-|13 0 
00 4 


The cofactors of the elements of the first row give the eigenvector as, 


12 3 

X,=|-4} or | -1 

0 0 
-2 6 | 
WhenA-73,A4-ÀI-7|1 1 0 
0 0 0 


Since, the cofactors of the elements ofthe 1st and 2nd rows vanish completely, 
we consider the cofactors ofthe elements ofthe 3rd row to get the eigenvector as, 


X,=| 1 
-4 
-3 6 
WhenA-4,A4-AI-|1 -2 0 
0 0 -I 


Considering the cofactors of the elements ofthe 1st row we get the eigenvector 
as, 
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Eigen Values and 
2 Eigen Vectors 


X = 
0 
NOTES 
Properties of Eigenvalues and Eigenvectors 


1. Ifalltheeigenvalues ofa matrix are distinct, then the corresponding eigenvectors 
are linearly independent. 


2. Iftwo or more eigenvalues of a matrix are equal then the corresponding 
eigenvectors may be linearly independent or linearly dependent. 


3. Theeigenvalues ofa matrix and its transpose are the same. The characteristic 
equation of A and A’ (the transpose of A) are, 

ld—Al| = 0 ..(5.3) 

and |47— 2] =0 (5.4) 

LHS of Equation (5.4) is the determinant obtained by interchanging rows into 

columns of |4 — AJ]. Since, the value of a determinant is unaltered by the 


interchanging of rows and columns, Equations (5.3) and (5.4) are identical. 
Therefore, the eigenvalues of a matrix and its transpose are the same. 


4. The sum of the eigenvalues of a matrix A, is equal to the sum of the diagonal 
elements of A. The sum ofthe diagonal elements is called the Trace of the 
matrix A. The characteristic Equation of A is, 


-BA + B.A"? —.... + (-1)"B, = 0 (5.5) 
Where, B, =sum of the diagonal elements of A. ...(5.6) 
Let, Aj, Ay,....., A, be the roots of Equation (5.5) 


Then, A, +A, +.... +A, = -$ =p, sald?) 
From Equations (5.6) and (5.7) we find that the sum of the eigenvalues is equal to 
the sum of the diagonal elements. 

5. The product ofthe eigenvalues ofa matrix A is |4|. 
The characteristic Equation of A is, 
À,— BA + B5A7? — .... + (-1Y'B, = 0 (5.8) 
Where, D, = Determinant of A. 
If, Ay, Ay,.-.-,A,, be the roots of Equation (5.8) then 


Dis Noseeephy = C y Pe - p, (5.9) 
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Eigen Values and From Equations (5.8) and (5.9) we find that the product of the eigenvalues is 
EUER He UN. equal to the value ofthe determinant of A. 


6. Theeigenvalues ofa triangular matrix are the diagonal elements of it. 


NOTES Notes: 


1. The sum ofthe eigenvalues ofa matrix A, is equal to the sum of the 
diagonal elements of A, which is called the Trace of the matrix A. 


2. Ifone ofthe eigenvalues is zero, then the matrix is singular and conversely, 
when the matrix is singular then at least one of the eigenvalues ought to 
be zero. 


3. The eigenvalues ofa diagonal matrix are the diagonal elements of it. 
7. IfA,for(i=1,2,3,...,2) are the eigenvalues of A, then: 


(i) kd; for (i= 1,2,3.....,2) are the eigenvalues of the matrix kA, k being a 
non-zero scalar. 


1 
(ii) E (i= 1,2,3.....,2) are the eigenvalues of the inverse matrix d provided 
À;z0 


()  LetX;(i— 1,2,3.....,2) be the eigenvectors of the matrix A corresponding 
to the eigenvalues of Xi = 1,2,3,....,5). Then, 


AX; — ÀX, (i= 1,2,3,....,5) ...(5.10) 
Multiplying by k, (a non-zero scalar): 
kAX; = KAX; 
This implies that kA, for (i= 1,2,3.,....,7) are the eigenvalues of kA. 
(ii) Premultiply Equation (5.10) by 4! 
AIAX, = AMA, 
IX, = hA X, or AX, = ù X 
This implies that A, ', for (i= 1,2,3,...,n) are the eigenvalues of 4 ! 


In general, if Ai = 1,2,3,...,7) are the eigenvalues of A, then A;"(i = 
1,2,3,...,), where m is an integer, are the eigenvalues of A”. 


Note: A and A" ( m being an integer) have the same eigenvectors even though the 
eigenvalues are different. 


3.00 
Example 5: Find the sum ofthe squares oftheeigenvaluesof|8 4 0}. 
6 2 5 
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Solution: Theeigenvaluesare3, 4and 5. Hence, thesum ofthe squaresofeigenvalues Eig ae s 
igen Vectors 


=50. 
6 -2 2 

Example 6: Two eigenvalues of matrix | -2. 3  -1|are2and8. Find the third NOTES 
2 -1 3 

eigenvalue. 


Solution: Sum ofthe eigenvalues = Sum ofthe diagonal elements = 6+ 3 +3 = 
12. 


Since the sum of the 2 given eigenvalues is 10 (2+8), the third eigenvalues is 
12 — 10 - 2. 


8 -6 2 
Example 7: If3 and 15 are the two eigenvalues of | -6 7  -4 ,findthevalue 
2 -4 3 


of the determinant. 
Solution: Let, A,, ù, A; be the eigenvalues. 
Then, A, +A, +A, =8+74+3;3+15+A,=18 3470 


The value of the determinant = Product of the eigenvalues = 0 
Values of the determinant is zero. 


Example 8: If one of the eigenvalues of a matrix is zero, then what is the type of 
matrix? 


Solution: The matrix is singular. 


0 1 1 
Example 9: Find the eigenvalues and eigenvectorsof |1 0 1 
1 1 0 


Solution: The characteristic equation is A? — 34.—2 — 0. Solving this equation we 
get the eigenvalues as -1, —1 and 2. 


-Aà 1 1l] 
Theeigenvaluesaregivenby| 1 -A 1 || x, |=0 
1 1 -A |} x, 


—Ax, +X) +x; = 0, x, — Ax +x; = 0, x, + x, — Ax, = 0 
Case 1: à — 2 gives: 
— 2x, +x, +x, = 0, x, — 2x, +x, = 0, x, +x, — 2x; = 0 
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NOTES 
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1 
Solving any two of these equations we get eigenvector X, = | 1 
1 


Case 2: A=—1 gives: 
xi tx tx = 0, x, +x, tx = 0, x +x, tx = O0 


Solving any two of these equations we get x, = 0, x = 0, x, = 0 and the vector x, 
becomes a null vector which cannot be an eigenvector. This is because ofthe fact 
that all the three equations are one and the same. The rank of coefficient matrix is 
1. Therefore, the system will have (n — r) = (3 — 1) = 2 linearly independent 
solutions. This indicates that, corresponding to A ——1, there will be two linearly 
independent eigenvectors. 


To get the solutions, we assign arbitrary values to two of the three variables as shown 
below. Considering the equation x, +x, +x; = 0 and assigning x4 = 0, x, = 1, we 
get x, 7-1. 


-1 
^. The eigenvector is X,=| 1 
0 


Similarly, assigning the value x, =0, x, = 1 we get x, ——1, so that the eigenvector 
is, 


Example 10: Show that the eigenvalues of A = È ‘| are—1, 3 and verify that 


the eigenvalues are 1 and 9 for 4^. 


Solution: The characteristic equation is A? — 24—3 — 0. The eigenvalues are -1, 


3 and the corresponding eigenvectors are E and il By property, the 
1 1 


eigenvectors of A’ are 1, 9 and the corresponding eigenvectors are (-1, 1)’, 
(1, 1)" 


Verification: 4^ = i has the characteristic equation, A” — 10A+9=0. 


Eigen Values and 
Eigen Vectors 


This equation gives the eigenvalues 1, 9 and eigenvectors " and | i ; 


Inner Product NOTES 


Inner product or scalar product of two vectors X and Y, denoted by « X, Y> is 
defined as the scalar X "Y 


i.e., (X, X eX Y xy 

i=l 
Inner product (X, X) is known as the square of the length of the vector X and it is 
denoted as |X|’, where |X] is read as norm X. If |X| = 1 then X is called a unit 
vector. 
Ifthe inner product between two vectors vanishes, then we say that the two vectors 
are orthogonal to each other. 


Example 11: Show that X= (1, —1, 2)” and Y= (3, —1, 2) are orthogonal. 


3 
Solution: < X, Y» - Y'Y - (1, 1,2) -1 | =3+1=4=0. 
-2 


Hence, X and Y are orthogonal. 


Eigenvalues of Real Symmetric Matrix 


Let À be an eigenvalue and X be the corresponding eigenvectors of the real 
symmetric matrix A. Then, 


AX — AX 
Multiplying by X ' on both sides, 
Y'AX-X"X (5.11) 


Taking complex conjugate on both sides, 


Since A isreal, 4 =A 
X'AX -X'AX 
Taking transpose on both sides, 
(x'4X) - (xax) 
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NOTES 
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X'A'X-X'AX -AX'X 
Since A is symmetric A’ =A 
x X'AX 2AX'X (5.12) 
From Equations (5.11) and (5.12) we get 
AX'X —-AX'X 
(A-A)X'X 20 


Since X' X is non-zero, i = à . Therefore A is real. 


Theorem 1: /f X, and X, are two eigenvectors corresponding to two different 
eigenvalues à; and X, of a real symmetric matrix A, then X, and X, are 
orthogonal. 


Proof: Since X, and X, are the eigenvectors of matrix A corresponding to the 
eigenvalues A,and A,, we have, 


AX, =X, (i) 
AX, = h,X) (ii) 
Premultiplying Equation (7) by X7 we get, 
X: AX = X AX, 
Taking transpose on both sides we get, 
QG AX Y= (XX1 
PAG x 
X AX =M XiX, where =A, since A is symmetric. 


XI hX = AX, X, [Using Equation (ii)] 
-X X, = 0 
Since, (A, #A,), X; X% =0 
L.e., X, and X, are orthogonal. 
10 -2 -5 
Example 12: Find the eigenvalues of the matrix | -2 2 3 | and verify thatthe 
=) 0" c 


eigenvectors are mutually orthogonal. 


10 -2 -5 
Solution: Let 4-|-2 2 3 
-5 3 5 


TEL ue E Queis) 
The characteristic equation is, 

A - 17A + 422 =0 

MA? — 17+ 42)- 0 


(A-3) (A-14) =0 


NOTES 


The eigenvalues are 0, 3 and 14. To find the eigenvectors we consider, 


(10-2) x, — 2x, —5x, =0 
—2x, E (2 =p Ay, + 3x, = 0 
—5x, E 3x, T (5 = Aya = 0 


Case 1: A — 0 gives: 


10x, — 2x, — 5x; = 0, 2x + 2x, + 3x, = 0 


1 


Solving we get eigenvector X, = | -5 
4 


Case 2: A =3 gives: 


7x, — 2x, — 5x4 = 0, —2x, =x + 3x, = 0 


1 


Solving we get eigenvector X, = | 1 
l 


Case 3: A= 14 gives: 


4x, — 2x, — 5x, = 0, -2x, + 12x, + 3x, =0 


-3 
Solving we get eigenvector X; — | 1 
2 


l 1} | -3 
. The eigenvectors are | -5 |,| 1 |,| 1 
4 | |1|] 2 
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Eigen Values and X X, = 0, X X4 = 0 and X; X, =0 


Eigen Vectors 


Hence, the three eigenvectors are mutually orthogonal. 


Note: It may be seen that any matrix, whose elements are polynomials can be 
NOTES expressed as a polynomial whose coefficients are matrices and vice versa. The 
following two examples illustrate this concept. 


Example 13: Express the following matrices as polynomials with matrix 
coefficients. 


Q(X-222 13-3 
(i) Pale 
143A -À 


142X447 AHA -A AN3A 5A 
(i) | A-342 -1 A+A 1-307 4.403 
A+A? -1 0 AHA ERAI 


2 3 
Solution: (7) MEUM ON 7 
14-3X —À 


Jo (2-0 1 0) (0 -3 
=) +À +À + 
0 0 0 -l 3 0 1 0 
= AX + BX? + CÀ + D, where A,B and C are matrices. 


1+A+A7 AHA- A 3A? 45041 


(ii) A? —3A? -1 R40 1-33? +423 
A+A? -1 0 A+A? ERAI 
= AP +B} +CA+D 
Where, 
-] 1 1 1 -3 
1 1 0 0 1 
1 5 1 0 1 
0 1 -1 0 1 


5.3 JACOBI AND POWER METHODS 


In numerical linear algebra, the Jacobi method is an iterative algorithm for 
determining the solutions ofa strictly diagonally dominant system of linear equations. 
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Each diagonal element is solved for, and an approximate value is plugged in. The Eigen Values and 
s : PE à " g : . Eigen Vectors 

process is then iterated until it converges. This algorithm is a stripped-down version 

of the Jacobi transformation method of matrix diagonalization. The method is named 


after Carl Gustav Jacob Jacobi. 


f : . : NOTES 
In mathematics, power iteration, also known as the power method, is an 


eigenvalue algorithm: given a diagonalizable matrix A, the algorithm will produce a 
number A, which is the greatest (in absolute value) eigenvalue of A, and a nonzero 
vector v, which is a corresponding eigenvector of À, that is, 4v = Av. The algorithm 
is also known as the Von Mises iteration. 


Power iteration is a very simple algorithm, but it may converge slowly. The 
most time-consuming operation ofthe algorithm is the multiplication of matrix A by 
a vector, so it is effective for a very large sparse matrix with appropriate 
implementation. 


Jacobi Method 
As per the Jacobi method, 
Let, 
Ax — b bea square system of linear equations. 
Where, 
41 412 -^'*' Gin xy by 
a2, 022 *** Gan 2 by 
A = 9 x= ; b = 
Gn]  Qn2 *** Amn Tn b, 


Then A can be decomposed into a diagonal component D, a lower triangular 
part L and an upper triangular part U: 


A=D+L+U 
Where, 
11 0 0 
0 0.55 0 
D= 
0 0 ST Ann 
And, 
0 ap Ain 
an 0 An 
L+U= 
Anl Anm? **" 0 
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Eigen Values and The solution is then obtained iteratively by means of, 
Eigen Vectors 


x") = D! (b — (L + U)x")) 


NOTES Where x" is referred as the Ath approximation or iteration of x and x*'? is 
the next or k + 1 iteration of {\displaystyle \mathbf {x} } x. The element-based 
formula is thus: 


(k+1 1 ik "s 
ti == b; — 1 ayn) 6 £=1,3,...5%: 
ji 
The computation of zt Ü requires each element in x? except itself. Unlike 


( 


4 


(k+ 


the Gauss-Seidel method, we cannot overwrite 4 k) with E 1) , as that value 


will be necessary for the rest of the computation. The minimum amount of storage 
is two vectors of size n. 


Power Method 


The power iteration algorithm starts with a vector b,, which may be an approximation 
to the dominant eigenvector or a random vector. The method is described by 


the recurrence relation, 
Ab; 
be = 
|| Ab; || 


Consequently, at every iteration, the vector b, is multiplied by the 
matrix A and normalized. 


If we assume that A has an eigenvalue that is strictly greater in magnitude 
than its other eigenvalues and the starting vector b, has a nonzero component in 
the direction of an eigenvector associated with the dominant eigenvalue, then a 
subsequence (b,) converges to an eigenvector associated with the dominant 
eigenvalue. 


Without the two assumptions above, the sequence (b,) does not necessarily 
converge. In this sequence, 
by = e? + mr, 
Where v, is an eigenvector associated with the dominant eigenvalue, 


and ||r|| — 0.. The presence of the term ex implies that (b,) does not 


converge unless e'*k — 1. As per the two assumptions listed above, the 
sequence (u) is defined by, 
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bi Ab, 
bibi 


Hk = 


This converges to the dominant eigenvalue. 


1. Define the terms eigenvalue and eigenvector. 


3. Define inner product. 


. Define any two properties of eigenvalues and eigenvectors. 


Check Your Progress 


5.4 


5.5 


— 


ANSWERS TO CHECK YOUR PROGRESS 
QUESTIONS 


. LetA= [a] be a square matrix of order n. If there exists a non-zero (non- 


null) column vector X and a scalar / such that, 
AX =hX 


Then A is called an eigenvalue ofthe matrix A and X is called eigenvectors 
corresponding to the eigenvalue A. 


. (i) Ifall the eigenvalues ofa matrix are distinct, then the corresponding 


eigenvectors are linearly independent. 
(ii) Iftwo or more eigenvalues of a matrix are equal then the corresponding 
eigenvectors may be linearly independent or linearly dependent. 


. Inner product or scalar product of two vectors X and Y, denoted by « X, Y^ is 


defined as the scalar X "Y 


i.e., (X, X\=X'Y =} xy; 


i=l 


Inner product (X, X) is known as the square of the length of the vector X and 
it is denoted as |X|’, where |X] is read as norm X. If |X| = 1 then X is called a 
unit vector. 


SUMMARY 


Let A = [a] bea square matrix of order n. If there exists a non-zero (non- 
null) column vector X anda scalar / such that, 


AX =X 


Then A is called an eigenvalue ofthe matrix A and X is called eigenvectors 
corresponding to the eigenvalue A. 


Eigen Values and 
Eigen Vectors 


NOTES 
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e [f Ais ann x n matrix, then its characteristic equation is an nth degree 
polynomial equations in A. Therefore, an n x n matrix has n eigenvalues 
(real or complex). 


e An eigenvector ofa matrix cannot correspond to two different eigenvalues. 
e An eigenvalue ofa matrix can, and will correspond to different eigenvectors. 


e If A is an eigenvalue of matrix A of order 3, then the components of the 
eigenvector of matrix A corresponding of À are proportional to the cofactors 
ofthe elements of any row of |A — A/| provided that not all of them vanish. 


e If all the eigenvalues of a matrix are distinct, then the corresponding 
eigenvectors are linearly independent. 


e Iftwo or more eigenvalues ofa matrix are equal then the corresponding 
eigenvectors may be linearly independent or linearly dependent. 


S.6 KEY WORDS 


e Eigen Value Problem: The problem of finding the values of the parameter 
À, for which the homogeneous system, possesses non-trivial solution is 
known as characteristic value problem or eigenvalue problem. 


AX —-AX 
e Inner Product: Inner product or scalar product of two vectors X and Y, 


denoted by « X, Y> is defined as the scalar X "Y 


i.e., CIO eX =} xy, 


5.7 SELF ASSESSMENT QUESTIONS AND 
EXERCISES 


Short-Answer Questions 


1. Define any three properties ofeigenvalues and eigenvectors. 


2. What is an inner product? 


Long-Answer Questions 


6 -2 2 
1. Find the eigenvalues and eigenvectors of 4 =| -2 3 -1l. 
2. = 3 


2. If X, and X, are eigenvectors corresponding to distinct eigenvalues of À, 
and i, of A, then show that X, and X, are linearly independent. 


3. Find the eigenvalues ofthe following matrices: 


: Sud A ] l+i 
O0 ; Oe i 
2 23. 3 10 5 
(iii) |1 3 1 (iy) |-2 -3 «4 
[2332 3 5 7 
] i=j 
4. Let k, k, k, > 0 and A=[a, ] where a,, — LA s (i, j=1,2,3) 


Write the matrix A and find its eigenvalues. 
5. Write 3 matrices whose characteristics equation is A?— 7A + 6 — 0. 


6. Findthe eigenvalues and eigenvectors of3 x 3 null matrix. 


2 -1 
4 
] 


2 


7. Find the sum and product of the eigenvalues of i 


0 


N BR U e 
me N N © 


8. Eigenvalues ofa matrix are 1,—1 and 2. Find the value of Trace (4) and 


determinant A. 
7 4 =A 
9. 4—|4 -8 -1|.Ifone the eigenvalues of A is —9, find the other two 
4 -1 -8 
eigenvalues. 
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UNIT6 INTERPOLATION AND Apor ai panog 
APPROXIMATION 


NOTES 


Structure 
6.0 Introduction 
6.1 Objectives 
6.2 Interpolation and Approximation 
6.3 Answers to Check Your Progress Questions 
6.4 Summary 
6.5 Key Words 
6.6 Self Assessment Questions and Exercises 
6.7 Further Readings 


6.0 INTRODUCTION 


Interpolation is the process of defining a function that takes on specified values at 
specified points. Polynomial interpolation is the most known one-dimensional 
interpolation method. Its advantages lies in its simplicity of realization and the good 
quality ofinterpolants obtained from it. You will learn about the various interpolation 
methods, namely Lagrange's interpolation, Newton's forward and backward 
difference interpolation formulae, iterative linear interpolation and inverse 
interpolation. 


In this unit, you will study about the interpolation, approximation, Hermite 
interpolation, piecewise and spline interpolation and bivariate interpolation. 


6.1 OBJECTIVES 


After going through this unit, you will be able to: 
e Understand the interpolation and approximation 
e Analyse the Hermite interpolation 


e Explain the piecewise, spline interpolation and bivariate interpolation 


6.2 INTERPOLATION AND APPROXIMATION 


The problem of interpolation is very fundamental problem in numerical analysis. 
The term interpolation literally means reading between the lines. Innumerical analysis, 
interpolation means computing the value ofa function f(x) in between values of x 
in a table of values. It can be stated explicitly as “given a set of (n + 1) values y, 
Vis Vo Y, FOT X= Xos Xj Xz» ..., x, respectively. The problem of interpolation is to 


compute the value ofthe function y =f (x) for some non-tabular value of x.’ 
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The computation is often made by finding a polynomial called interpolating 
polynomial of degree less than or equal to n such that the value of the polynomial 
is equal to the value ofthe function at each ofthe tabulated points. Thus if, 


Q(x) = aj ax * ax? 4 a, x" 
(6.1) 
is the interpolating polynomial of degree < n , then 


O(x,)=y, for 1=0,1,2,..., n 
(6.2) 


It is true that, in general, it is difficult to guess the type of function to 
approximate f (x). In case of periodic functions, the approximation can be made 
bya finite series oftrigonometric functions. Polynomial interpolation is a very 
useful method for functional approximation. The interpolating polynomial is also 
useful as a basis to develop methods for other problems such as numerical 
differentiation, numerical integration and solution of initial and boundary value 
problems associated with differential equations. 


The following theorem, developed by Weierstrass, gives the justification for 
approximation ofthe unknown function by a polynomial. 
Theorem 6.1: Every function which is continuous in an interval (a, b) can be 
represented in that interval by a polynomial to any desired accuracy. In other 
words, it is possible to determine a polynomial P(x) such that | f(x) - P(x) | <£, 
for every x in the interval (a, b) where £ is any prescribed small quantity. 
Geometrically, it may be interpreted that the graph of the polynomial y = P(x) is 
confined to the region bounded by the curves y = f(x)— € and y= f(x) & € for 
all values of x within (a, b), however small € may be. 


Fig. 6.1 Interpolation 


The following theorem is regarding the uniqueness ofthe interpolating 
polynomial. 


Theorem 6.2: For a real-valued function f(x) defined at (n + 1) distinct points Interpolation and 
. y NES Approximation 

X, X,» ..., X,, there exists exactly one polynomial of degree < n which interpolates 
Jf (x) at Xy X X 

We know that a polynomial P(x) which has (n + 1) distinct roots x,, x, ..., 
x, can be written as, 

PO) =O = X) œ- x) x) 09) 

where q(x) is a polynomial whose degree is either 0 or (n + 1) which is less than 
the degree of P(x). 


NOTES 


Suppose that two polynomials @(x) and y(x) are of degree <n and that 
both interpolate f(x). Here P(x) = q(x) - w(x) at x= xX x,,..., X,- Then P(x) 
vanishes at the n +1 points xo. x... x,. Thus P(x) =0 and (x) = y(x). 


Iterative Linear Interpolation 


In this method, we successively generate interpolating polynomials, of any degree, 
by iteratively using linear interpolating functions. 

Let p,,(x) denote the linear interpolating polynomial for the tabulated values at 
x, and x,. Thus, we can write as, 


(x, —x) fo - (9 — X) fi 


Xp = Xo 


Pa) = 
This can be written with determinant notation as, 


fo X7x 
f »-x 


Xi = Xo 


Pa (x) = (6.3) 


This form ofp, (x) is easy to visualize and is convenient for desk computation. 
Thus, the linear interpolating polynomial through the pair of points (x,, f;) and 


(x;,;) can be easily written as, 


f %-x 


f dc 
Now, consider the polynomial denoted by Po) and defined by, 


1 


J= *o 


Po; (x)= , for j=1,2,...,n (6.4) 


x 


pa). x -x 


Po jx) X;—X 


1 


x, =X 


Po; œ) = , for j= 2, 3, 0.51 (6.5) 


The polynomial Poy) interpolates f(x) at the points x,,x,, x (71) andisa 
polynomial of degree 2, which can be easily verified that, 


Poy X0) = Jos Poy ©) = f; and py, (x,) = f; because py, (x,) = fo = Poy x»), etc. 


Similarly, the polynomial po12; (x) can be constructed by replacing p (x) by 
Porn ©) and py (x) by Poy (x). 
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Paz) X% -x 


Poij (x) x; —x 


1 


X; =X 


Poizj (x)= 


, for j=3, 4,..,n (6.6) 


NOLES Evidently, p,, œ) is a polynomial of degree 3 and it interpolates the function 


at x,, x,, x, and x. 


i.e., Po12; (x9) = fo; Po12; (x) 2 fi Doizj (x)= f; and Po12; (x;) = Í; 
This process can be continued to generate higher and higher degree 
interpolating polynomials. 


The results ofthe iterated linear interpolation can be conveniently represented 
as given in the following table. 


Xy Sk Poj Poj = *j-X* 
Xo fo Xo —X 
x fi Poi x, 7x 
X) fo Po Pon X)—X 
x3 fs Pox Pos X3—X 
Xj fj Poj Poj Xj =X 
Xn ps Pon Poin XQ — xX 


The successive columns of interpolation results can be conveniently filled by 
computing the values of the determinants written using the previous column and 
the corresponding entries in the last column X,—X. Thus, for computing p, 5 for 

j72,3,..,n, we evaluate the determinant whose elements are the boldface 


quantities and divide the determinant's value by the difference (x; — x) - (x; - x). 


Example 1: Find s(2.12) using the following table by iterative linear interpolation: 


x 2.0 2.1 2.2 2:3 
s(x) 0.7909 0.7875 0.7796 0.7673 


Solution: Here, x= 2.12. The following table gives the successive iterative linear 
interpolation results. The details ofthe calculations are shown below in the table. 


Xj s(x;) Poj Poij Pg | X*;—X 
2.0 0.7909 — 0.12 
2.] 0.7875 0.78682 — 0.02 
2.2 0.7796 0.78412 0.78628 0.08 


2.3 0.7673 0.78146 0.78628 0.78628 0.18 
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Po = 


Po = 


Pon = 


1 
2.1-2.0 


RU 
22-20 


1 


723-20 


1 


~ 22-21 


— 
23-21 


Lm 
23225 


0.7909 
0.7875 
0.7909 
0.7796 
0.7909 
0.7673 
0.78682 
0.78412 
0.78682 
0.78146 
0.78628 


0.78628 


-0.12 
- 0.78682 
-0.12 
= 0.78412 
e 
-0.12 
- 0.78146 
0.18 
-0.02 
= 0.78628 
08 
-0.02 
= 0.78628 
0.18 
08 
= 0.78628 
0.18 


The boldfaced results in the table give the value ofthe interpolation at x= 
2.12. The result 0.78682 is the value obtained by linear interpolation. The result 
0.78628 1s obtained by quadratic as well as by cubic interpolation. We conclude 
thatthere is no improvement in the third degree polynomial over that ofthe second 


degree. 


Notes 1. Unlike Lagrange’s methods, it is not necessary to find the degree of the 
interpolating polynomial to be used. 


2. Theapproximation by a higher degree interpolating polynomial may 
not always lead to a better result. In fact it may be even worse in some 


cases. 


Consider, the function f(x) = 4. 


We form the finite difference table with values for x = 0 to 4. 


x f(x) AfG) MfQ) MfG) AF) 


0 1 
3 

1 4 

12 
2 16 

48 
3 64 

192 
4 256 


144 


81 


Newton’s forward difference interpolating polynomial is given below by taking 


Xo =9, 


X — Xy 


27 
x 


=x, @O(x)=14+3x+ = a(x 1)+ 


6 


(x—1)(x 2)4 Sata D(x —2)(x -3) 
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Interpolation and Now, consider values of (x) at x ^ 0.5 by taking successively higher and 
Approximation g ? 
higher degree polynomials. 
Thus, 


NOTES 
,(0.5) 21--0.5x3 22.5, by linear interpolation 


o, (0.5) 2 2.5 - MLM x9=1.375, by quadratic interpolation 


9.(0.5) 21.375 4.2 X —— ACL a3 0605... byceübicdnterpolatisdt 


(0.5) = 3.0625 + ee 92:5) (81- —0.10156, by quartic interpolation 


We note that the actual value 4°° — 2 is not obtainable by interpolation. The 
results for higher degree interpolating polynomials become worse. 
Note:  Lagrange's interpolation formula and iterative linear interpolation can easily 
be implemented for computations by a digital computer. 


Example 2: Determine the interpolating polynomial for the following table of data: 


x 1 2 3 4 
y -1 -1 1 5 


Solution: The data is equally spaced. We thus form the finite difference table. 


x y Ay Ny 

1 -1 
0 

2 -1 2 
2 

3 1 2 
4 

4 5 


Since the differences ofsecond order are constant, the interpolating polynomial 
is of degree two. Using Newton's forward difference interpolation, we get 


u(u —1) A? 
2! 


y-2yytuAy, + 


0? 


Here, x,=1, u-x-l. 


Thus, yale 0- Dx0 808 uas i 3x4 
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Example 3: Compute the value of f(7.5) by using suitable interpolation on the d E i 
following table of data. pproximation 


x 3 4 5 6 7 8 
f(x) 28 65 126 217 344 513 NOTES 


Solution: The data is equally spaced. Thus for computing (7.5), we use Newton’s 
backward difference interpolation. For this, we first form the finite difference table 
as shown below. 


SO AG) Vf) Wf) 


= 


3 28 

37 
4 65 24 

61 6 
5 126 30 

91 6 
6 217 36 

127 6 
7 344 42 

169 
8 513 


The differences of order three are constant and hence we use Newton's 
backward difference interpolating polynomial of degree three. 
, (vl) 


fG)- y, tv Vy, 7 y, 


v(v + D(v + 2) 
3! 


Vy, 


X% for x=7.5, x =8 


n 


y= 


(-0.5) (-0.5+1) ~0.5x0.5x1.5 . 


f(7.5) =513-0.5x 169 4 : 


x 42 4 


=513- 84.5- 5.25 - 0.375 
= 422.875 


Example 4: Determine the interpolating polynomial for the following data: 


x 2 4 6 8 10 
f(x) 5 10 17 29 50 
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pci. and Solution: The data is equally spaced. We construct the Newton's forward 
HEURE difference interpolating polynomial. The finite difference table is, 


x f(x) AQ) Xf) Mf(x) A'fQ) 


NOTES 2 5 

5 

4 10 2 
T 3 

6 17 5 1 
12 4 

8 29 9 
21 

10 50 


Here, x, = 2, u = (xh = (x-2y2. 
The interpolating polynomial is, 


f(x) = f(xy) +u Af) D A (4) +. 


254,47245,372 x-2 1 2 x-2 x-2 1 x-2 2 3 
2 2 2 2! 2 2 2 3! 


X22 x-2 1 x-2 2 x-2 3 1 
2 2 2 2 4! 


1 
= ae 4x? —52x? +1040 x) 


Example 5: Find the interpolating polynomial which takes the following values: 
y(0) = 1, (0.1) = 0.9975, (0.2) = 0.9900, (0.3) = 0.9980. Hence compute 


y (0.05). 
Solution: The data values of x are equally spaced we form the finite difference 
table, 
x y Ay Ny Ny 
0.0 1.0000 
-25 
0.1 0.9975 —50 
-75 25 
0.2 0.9900 -25 
—100 
0.3 0.9800 
Here, A =0.1. Choosing x, = 0.0, we have s = aa =10x. Newton’s forward 


difference interpolation formula is, 
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5 s(s—1) 2 s(s—-1)(s—2) 3 
Y= Yo +S Ayo + 2 A yo + ai A 


10x(10x —1)(10x — 2) 


= 1-10x(-0.0025) + 22078) (0.0050) + x0.0025 
l NOTES 
-1.0-0.25x -0.25x? £025 3 - T x0.0025x" ee 


= 1.0+0.004x —0.375x? + 0.421x° 
(0.05) = 1.0002 


Example 6: Compute 0.23) and (0.29) by using suitable interpolation formula 
with the table of data given below. 


x 0.20 0.22 0.24 0.26 0.28 0.30 
f(x) 1.6596 1.6698 1.6804 1.6912 1.7024 1.7139 


Solution: The data being equally spaced, we use Newton's forward difference 
interpolation for computing (0.23), and for computing f(0.29), we use Newton's 
backward difference interpolation. We first form the finite difference table, 


x. ur APG: NI) 


0.20 1.6596 
102 

0.22 1.6698 4 
106 

0.24 1.6804 2 
108 

0.26 1.6912 4 
112 

0.28 1.7024 3 
115 

0.30 1.7139 


We observe that differences of order higher than two would be irregular. Hence, 
we use second degree interpolating polynomial. For computing /(0.23), we take 
-xo 023-022 _ 

h 0.02 


0.5. 


XT 0.22 so that v = id 


Using Newton's forward difference interpolation, we compute 


/(0.23) = 1.6698. 0.5% 0.0106 ae 


x 0.0002 


= 1.6698 + 0.0053 — 0.000025 
= 1.675075 
= 1.6751 


Again for computing f (0.29), we take x, = 0.30, 
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I 0290305 . 6 
0.02 


so that v= 


Using Newton’s backward difference interpolation we evaluate, 


NOTES 


x 0.0003 


f (0.29) -17139-05x 015, CACO 


— 1.7139 — 0.00575 — 0.00004 
=1.70811 
=1.7081 


Example 7: Compute values of e* at x = 0.02 and at x = 0.38 using suitable 
interpolation formula on the table of data given below. 


x 0.0 0.1 0.2 0.3 0.4 
e 1.0000 1.1052 1.2214 1.3499 1.4918 


Solution: The data is equally spaced. We have to use Newton’s forward difference 
interpolation formula for computing e" at x = 0.02, and for computing e" at 
x — 0.38, we have to use Newton's backward difference interpolation formula. 
We first form the finite difference table. 


x y=e Ay My Wy My 


0.0 1.0000 
1052 
0.1 1.1052 110 
1162 13 
0.2 1.2214 123 -2 
1285 11 
0.3 1.3499 134 
1419 
0.4 1.4918 


For computing e^", we take x, = 0 


T x— xo  0.02-0.0 -0.2 
h 0.1 


By Newton’s forward difference interpolation formula, we have 


0.2(0.2-1)(0.2- 2) 
6 


0.2(0.2-1) 


e"? =1.0+0.2x 0.1052 + x0.0110 4 x 0.0013 


.02 (0.2-1(0.2- 20.2 -3) 
) 24 
= 1.0 + .02104 — 0.00088 + 0.00006 + 0.00001 


= 1.02023 = 1.0202 


x —0.0002 
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038-04 - 
0.1 
By Newton's backward difference interpolation formula, we have 


For computing e°** we take x, — 0.4. Thus, v= -0.2 


x 0.0134 


e = 14918 (-0.2)x0,1419 + 22102) 


" ee 32) 50011, 202+ pe +2(-02+3), 00092) 
= 1.4918 — 0.02838 — 0.00107 — 0.00005 — 0.00001 
= 1.49287 — 0.02844 
= 1.46443 ~ 1.4644 


Lagrange's Interpolation 


Lagrange’s interpolation is useful for unequally spaced tabulated values. Let y — 
(x) be a real valued function defined in an interval (a, b) and let y,, y,...., y, be the 


(n + 1) known values of y at x,, x,,....x, respectively. The polynomial q(x), 
which interpolates f (x), is of degree less than or equal to n. Thus, 
Q(x)-2y, for i=0,1,2,...,7 


(6.7) 
The polynomial @(x) is assumed to be of the form, 
p(x) = Y LG)y, 
i=0 
(6.8) 


where each / (x) is a polynomial of degree <n in x and is called Lagrangian 
function. 


Now, (x) satisfies Equation (6.7) if each / (x) satisfies, 
L(x;) 20 when iz]j 
zi when i=j 
(6.9) 
Equation (6.9) suggests that / (x) vanishes at the (n+1) points x,, x, ... x, ,, 
.,X,. Thus, we can write, 
LX) = CARH) c3 i ASKS) SX Det) 


where c, is a constant given by l, œx) -1, 


X 


ipt 


ie, c; (x; X) GO -x).G;7x,) GG 7 x4). (5; 7x,)271 


Thus, L(x) = (x = Xp (X= X,)..(H —x 4.) — 2,4). (x 7 xX,) for i=0, L 2, n 
(x; = Xo); =x); = xa); = Xa); —x,) 


(6.10) 


Interpolation and 
Approximation 


NOTES 
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F WR us E Equations (6.8) and (6.10) together give Lagrange's interpolating polynomial. 
Algorithm: To compute f (x) by Lagrange's interpolation. 
Step 1: Read n [n being the number of values] 
NOTES Step 2: Read values of x, f, for i — 1, 2,..., n. 
Step 3: Set sum - 0, i= 1 
Step 4: Read x [x being the interpolating point] 
Step 5: Set j = 1, product = 1 
Step 6: Check ifj + i, product = product x (x — x,)/(x,—x,) else go to Step 
7 
Step 7: Setj=j +1 
Step 8: Check ifj > n, then go to Step 9 else go to Step 6 
Step 9: Compute sum = sum + product x f: 
Step 10: Set;- i1 
Step 11: Check ifi > n, then go to Step 12 
else go to Step 5 
Step 12: Write x, sum 
Example 8: Compute f (0.4) for the table below by Lagrange's interpolation. 


x 03 05 06 
f(x) 0.61 0.69 0.72 


Solution: The Lagrange's interpolation formula gives, 


_ (04-0.5(0.4-0.6) | 4 g] | (04-0.3(0.4-0.6) | 9 gy, (04-0.3(04-0.5). 
(0.3-0.5)0.3—0.6) ^ (0.5—0.3(0.5—0.60) ^ (0.6—0.3)(0.6 — 0.5) 
= 0.203 + 0.69 — 0.24 = 0.653-:0.65 


Thus, /(0.4) — 0.65. 


Example 9: Using Lagrange’s formula, find the value off (0) from the table given 
below. 


0.72 


(0.4) 


x -1 -2 2 4 
f(x) -1 -9 11 69 


Solution: Using Lagrange’s interpolation formula, we find 


fo (04240-20079. i (0+1(0-2)(0-4) 
(-1+2)(-1-2)(-1-4) (-24)-2-2)-2- 4) 
«209-2021. 00:202 9] 
(2+1)(2+2)(2—4) (44+1)(4+2)(4—2) 
16 9 11 69 20 85 
+—+ = 
15 3 3 15 3 15 


x( J 
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Example 10: Determine the interpolating polynomial of degree three for the table Interpolation and 
: Approximation 
given below. 


x -101 2 


$Gy 1 11 -3 NOTES 
Solution: We have Lagrange’s third degree interpolating polynomial as, 


3 
f= DVU@OLO) 


i=0 
where 


ee SST) re) ene 
fo) 7t 1-0CI-DCI-2 zu Dx -2) 
|. (x*D(x-D(x-2) 1 


10) E EDE- -D 
_ (&+D@-0@-2) 1 E a 
BO Gioia) 25 «2 


Lys (x-1D(x-0)(x-1) 1 


Q«no-oQ-) e *Dxe-2 


f(x) ca D 2L ez Ge 1)(x -2)x1 (re Dx 2M ec (r+ Dae 2)x(-B) 
= -2 P 4-6 
= 02x -2x-3) 


Example 11: Evaluate the values off (2) and f (6.3) using Lagrange's interpolation 
formula for the table of values given below. 


x 12 25 4 51 6 65 
f(x) 6.84 1425 27 3921 51 5825 


Solution: It is not advisable to use a higher degree interpolating polynomial. For 
evaluation off (2) we take a second degree polynomial using the values of f(x) at 
the points x, = 1.2, x, = 2.5 and x, = 4. 


Thus, 
f (2) =1,(2) x 6.84 + (2) x 14.25 + L(2) x 27 
Where 
1,(2) = Qo). 098 
(1.2-2.5)(1.2—4) 
1(2) - G- TQ 0-821 
(2.5-1.2)2.5- 4) 
LO (2-1.2)2-2.5) | 995 


(4-1.2)4 -2.5) 
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- f (2) = 0.275 x 6.84 + 0.821 x 14.25 - 0.095 x 27 = 11.015 «11.02 


For evaluation of f (6.3), we consider the values of f(x) at x, = 5.1, x, = 6.0, x, 
= 6.5. 


Thus, f (6.3) = 1,(6.3) x 39.21 -1,(6.3) x 51 +1,(6.3) x 58.25 


where 


—0.048 


1,(63)- (63-69463-65) _ 
(5.1—6.0)(5.1— 6.5) 

1, 6.3) = 63-5-63-65) _ 9 533 
(6-5.1)(6.0- 6.5) 

(6.3-5.1)(6.3—6.0) 

(6.5—5.1)(6.5 — 6.0) 


1, (6.3) = = 0.514 


^. f(6.3) = —0.048 x 39.21 + 0.533x 51+ 0.514 x 58.25 
= 55.241 = 55.24 


Since, the computed result cannot be more accurate than the data, the final 
result is rounded-off to the same number of decimals as the data. In some cases, 
a higher degree interpolating polynomial may not lead to better results. 


Interpolation for Equally Spaced Tabular Values 


For interpolation of an unknown function when the tabular values of the argument 
x are equally spaced, we have two important interpolation formulae, viz., 


(i) Newton’s forward difference interpolation formula 


(ii) Newton's backward difference interpolation formula 


We will first discuss the finite differences which are used in evaluating the 
above two formulae. 


Finite Differences 


Let us assume that values of a function y = f(x) are known for a set of equally 
spaced values of x given by (x, x,...., x, j, such that the spacing between any 
two consecutive values is equal. Thus, x, =x th, x, =x, th... x —-x, th, 
so that x, — x, + ih for i= 1, 2, ...,n. We consider two types of differences known 
as forward differences and backward differences of various orders. These 
differences can be tabulated ina finite difference table as explained in the subsequent 
sections. 


Forward Differences 


Let yp Yp- y, be the values ofa function y =f (x) at the equally spaced values of 
X —X, X, ..., X. The differences between two consecutive y given by Yi 7X; 
=Y p- Y, —- y, are called the first order forward differences of the function y =f 
(x) at the points x,, x,,..., x, ,. These differences are denoted by, 


Ay, EV Yo AX =. Yio s Va E Ya T Yni Inrerpolarion:and 


Approximation 


(6.11) 
where A is termed as the forward difference operator defined by, 
Af (x) = f(x h)- f(x) NOTES 
(6.12) 
Thus, Ay, - y,,— y, fori — 0, 1, 2, ..., n — 1, are the first order forward 
differences at x, 


The differences ofthese first order forward differences are called the second 
order forward differences. 


Thi 
A*y, =A(Ay,) 
= Ay,,, —Ay,, for i =0, 1, 2, ...,n-2 (6.13) 
Evidently, 
A yy = Ay, - Ayo = Ya - 3i Qi - Yo) = V2 -2V1 + Yo 
And, Ay; = us -Yia - Oa - X2) 
L.e., Ay, = Yaa 2Y + y» for i=0,1,2,...,n—2 
(6.14) 
Similarly, the third order forward differences are given by, 
Ny, mA ys3 -Ay, for i=0, 1, 2, ..,n—3 
i.e., A y, = Yia3 3Y53 | 3y Xi 
(6.15) 
Finally, we can define the nth order forward difference by, 
n -1 n 
A yo c Y, na + a l y ate (DY 
(6.16) 


The coefficients in above equations are the coefficients of the binomial expansion 
(1 — xy. 

The forward differences of various orders for a table of values of a function 
y=f(x), are usually computed and represented in a diagonal difference table. A 
diagonal difference table for a table of values of y =f (x), for six points x, x,,x,, 
X4, X, X, is shown here. 
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Diagonal difference Table for y = f(x): 


i x; y; Ay My, Ny Ay, Wy, 
0 xg yo 


Ayo 
lx » A yg 
Ay A’ yp 
2 x Vy Ny, N yo 
Ay; N y, A yo 
3 x y» Ny, A! y, 
Ay; Ny; 
4 X4 V4 Ny? 
Ay4 
5 Xs Js 


The entries in any column ofthe differences are computed as the differences 
ofthe entries ofthe previous column and one placed in between them. The upper 
data in a column is subtracted from the lower data to compute the forward 
differences. We notice that the forward differences of various orders with respect 
to y, are along the forward diagonal through it. Thus Ay,, A’y,, A5y,, Aty, and 
A’y, lie along the top forward diagonal through y,. Consider the following example. 


Example 12: Given the table of values of y = f(x), 


x13 57 9 
y 8 12 21 36 62 


form the diagonal difference table and find the values of Af(5), A? f (3), A’ f (1). 


Solution: The diagonal difference table is, 


i x; y, Ay, My, My, My 


0 1 8 
4 
1 3 12 5 
9 1 
2.5 21 6 4 
15 5 
3 7 36 11 
26 
4 9 62 


From the table, we find that Af(5) = 15, the entry along the diagonal through 
the entry 21 of f(5). 


Similarly, A’ £(3)=6, the entry along the diagonal through f (3). Finally, 
N f(1) 21. 


Backward Differences 


The backward differences of various orders for a table of values ofa function y= 
f (x) are defined in a manner similar to the forward differences. The backward 


difference operator v (inverted triangle) is defined by V/(x) = f(x) - f(x - 4). 


Thus, Vy, =Y, -Yy for k2L2,..,n 


i.e., Vyi = Yi - Yos VY2 = Ya 7 Vis Vn = Yn 7 Yn 
(6.17) 
The backward differences of second order are defined by, 
V^y, = Vy, - Vy, = Y. 2Y4a + Ya 
Hence, 
V? y, 2 y; -2yj + yo, and Vy, = y, -2y, 4 Y. 
(6.18) 
Higher order backward differences can be defined in a similar manner. 
Thus, V3y, = Ya —3Yn-1 +3Yn-2 — Yn-3> etc. 
(6.19) 
Finally, 
n n(n T 1) n 
V'y,2y,-ny,,* 5 i Jio ey) Jo 
(6.20) 


The backward differences of various orders can be computed and placed in a 
diagonal difference table. The backward differences at a point are then found 
along the backward diagonal through the point. The following table shows the 
backward differences entries. 


Diagonal difference Table of backward differences: 


i x, y; Vy Vy V^y Vy; 


0 xo ye 


vy 

Lum n V?^y, 
Vy? Vy, 

2 Xy y» V^y, Vy, 
Vy3 Voy, 

3 x y V?y, V*y, 
Vy, Vy, 

4 X4 y4 V?^y, 
Vys 

5 X; ys 
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The entries along a column in the table are computed (as discussed in previous 
example) as the differences ofthe entries in the previous column and are placed in 
between. We notice that the backward differences of various orders with respect 


to y, are along the backward diagonal through it. Thus, vy,, v? y, , v? ys, Vy; and 


V^ y,are along the lowest backward diagonal through y.. 


We may note that the data entries of the backward difference table in any 
column are the same as those ofthe forward difference table, but the differences 


are for different reference points. 


Specifically, if we compare the columns of first order differences we can see 


that, 
Ayg = Vyas Ay, = Vy5,..., Ay, 4 = VY, 
Hence, Ay, = Vy,,, for i=0,1, 2,...,n-1 
Similarly, Ny, = V?y,, A’y, = V ias Ay, 27 V?y, 
Thus, A*y,=V’y,,,, for i=l, 2,.., n-2 
In general, Ay, = v*y, , . 


Conversely, v* y, = A^ y; ,. 


Example 13: Given the following table of values of y =f (x): 


xccLho3L- O4 9 
y 8122136 62 


Find the values of V y. V^ yo. V^ y. 


Solution: We form the diagonal difference table, 


X; VY; V?y; V?y, V^y, 


Xi 
1 8 
4 
3 12 5 
9 1 
5 21 6 4 
15 5 
7 36 11 
26 
9 62 


From the table, we can easily find Vy, =15, V^ Yo =11, y Ji 75. 


Symbolic Operators Interpolation and 
Approximation 


We consider the finite differences ofan equally spaced tabular data for developing 

numerical methods. Let a function y = f (x) has a set of values y,, y, Yz- 

corresponding to points x,, x,, x,,..., where x, =x, th, x, = x, + 2h,...., are NOTES 
equally spaced with spacing A. We define different types of finite differences such 

as forward differences, backward differences and central differences, and express 

them in terms of operators. 


The forward difference of a function f (x) is defined by the operator A, called 
the forward difference operator given by, 


Af (x) 7 f Ge h) - f(x) 


(6.21) 

Ata tabulated point x,, we have 
Af (x) = f x; t h) - f(x) 

(6.22) 

We also denote Af (x;) by Ay,, given by 
AY, = Yaa Yp fo i=0,1, 2,... 

(6.23) 

We also define an operator E, called the shift operator which is given by, 
E f(x) ^ f(x  h) 
(6.24) 
Af (x) = Ef (x) - f (x) 

Thus, A = E-1is an operator relation. (6.25) 


While Equation (6.21) defines the first order forward difference, we can define 
second order forward difference by, 


A y, E A(Ay;) = Ain —y;) 


A’y, = Ay,,, — Ay, (6.26) 
Shift Operator 
The shift operator is denoted by E and is defined by E f(x) =f (x + h). Thus, 
EY, = Var 


Higher order shift operators can be defined by, E°f(x) = Ef (x + h)=f(x + 
2h). 
Ey, = E(Ey) = EQ.) Ys 
In general, E"f (x) =f (x + mh) 
E'yk = Voom 
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Approximation 
From the definition of forward difference operator, we have 


Ay(x) = y(x t h) - y(x) 


NOTES 
- Ey(x) - y(x) 
-(QE-Dy(x) 
This leads to the operator relation, 
A=E-]1 
or, E=1+A 


Similarly, for the second order forward difference, we have 


A*y(x) = Ay(x +h) - Ay(x) 
= y(x+2h)—2y(x+h)+ y(x) 


= E’ y(x) —2Ey(x) + y(x) 
= (E’? -2E +1)y(x) 


This gives the operator relation, A? = (E-1)?. 


Finally, we have A" =(E-1)", for m=1, 2,... 


(6.27) 


(6.28) 


Relation between the Backward Difference Operator with Shift Operator 


From the definition of backward difference operator, we have 


Vf (x) = f G9) - f (x - h) 
= f(x)-E" f(x) =(1- £7) f(x) 


This leads to the operator relation, y =1- g~! 


Similarly, the second order backward difference is defined by, 


V? f(x) = Vf(x) - Vf (x — h) 
= fŒ- f(x-h)- f(x-h)* f(x-2h) 
= f(x) -2f(x- h)* f(x-2h) 
= f()-EfQ)*E? f(x) 
=(1-E'+E7) f(x) 
=(1-E") f(x) 


This gives the operatorrelation, V? = (1— E !)? andin general, 
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(6.29) 


(6.30) 


Relations between the Operators E, D and A 
We have by Taylor's theorem, 


f Gc) FG) MfG) 5 I") + 


h^ D d 
Thus, Ef (x) = f(x) - ADf(x) + B M 
! x 
kD? 
Or, a«ayeo- [reu 2 +} 
=e" f(x) 
Thus, e? =14+A=E 
Also, hD-log (1+A) 
2 3 4 
Or, Dexia. 9. 
2 3 4 
2 3 4 
pa [^ A rus S 3 
h 2 3 4 


Central Difference Operator 


The central difference operator denoted by 6 is defined by, 
h h 
dy(x) = s(x E z) E s(x - 2 


Sy(x) = (E - E 7)y(x) 


Thus, 


Giving the operator relation, § = E? — gp"? or §E'? = E-1 
Also, 


8y, = (E^ EB") y(x,) = E y, Ey, 


i.e., Oy, mau T Ys 
Further, 


^y, = 8 (Ò y,) =Ò Yr ZÒ Y, a5 
En -E"?) S E (£^ -E"?) (y, PA 


Zp? Dan -y,aua)- E We Dus -JY,u2) 
= Yan T Yn Ys um 


(6.31) 


= Ypa 72y,* x4 2 (E -EY y, = [Ayra = VV out | 


=(E+E'-2)y, 
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Interpolation and B 8 =F+E"-2 (6.32) 


Approximation 


Even though the central difference operator uses fractional arguments, still it is 
widely used. This is related to the averaging operator and is defined by, 


NOTES 
uo GU EU) (6.33) 


Squaring, u’ =T(E+24E = 28" +242)=1428' 


Au lens (6.34) 
It may be noted that, 8 y, = y, — y», = Vy, 


Also, ò E"? y "0x. =y,-y =m, 
2 


^ EŻ =A=E-1 (6.35) 
Further, 
y, 36's) =d d í78y | 
my n 2 
=8’y d -&y i = Ò( Y, —2y, + Y,a) 
2 


Example 14: Prove the following operator relations: 


(i) A=VE (ii) (1+ A) (1-V)21 

Solution: 

G) Sine Af(Qx)=fxth)-f@M=HO)-f@), A=E-1 (1) 
and since Vf(x)= f&)- f(x- A) -Qt- E )f(), Vsl- E" (2) 


E 
Thus, V=—— of VEZ E-12A 


Hence proved. 
(ii From Equation (1), we have EZ A41 (3) 
and from Equation (2) we get p~! 21- v (4) 


Combining Equations (3) and (4), we get (1-- A)(1— V) =1. 


Example 15: Iff is the value of f(x) at x, where x, — x, + ih, for i= 1,2,..., prove 
that, 


EE X. ^ f, 


j-0 
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Solution: We can write Ef (x) =f (x + h) Interpolation and 


Approximation 
Using Taylor series expansion, we have 


Ef (x) =f (x) - hf'(o) + K f"(3)4... NOTES 


P a d 
Z u a f(x)+..., where as 


araro iao 7 aro since E=1+A 
=e" f(x) 
1+A=e 


Hence, e”? =(1+A) 
Now, fo f) fos ih) = E' f(x) 
f,=(1+A)' f(%), since E=1+A 
afi), PODA , , 
f= $| Ja Jo, using binomial expansion. 
j=0\T 

Hence proved. 

Example 16: Compute the following differences: 
(i) A'e* (ii) A! x" 

Solution: 
(7) We have, Ae* 2 e**" —e* = e*(e^ —1) 

Again, A*e* = A(Ae*) = (e -1)Ae* =(e" 2-1? e" 

Thus by induction, A"e* = (e^ -1)"e*. 
(ii) We have, 

A(x") = (x 5)" - x" 


=nhx"! eD pye +... +h” 


Thus, A(x”) is a polynomial of degree (n — 1) 
Also, A(4") = 0. Hence, we can say that A? (x") is a polynomial of degree (n — 


2) with the leading term n(n-1)h?x"?. 
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Proceeding n times, we get 


A" (x") 2 n(n — D)... 1h" 2 nli" 


Example 17: Prove that, 

O A | ro- g(x) AFQ)- f (9) Ag Q) 
g(x) g(x) g(x +h) 

(ii) Aflog f(x)}= log + erol 

Solution: 

(i) We have, 


" e _ Sth) f) 
gx) g&œ+h) g(x) 
| f(xth)g(x)- f@g@th) 
g(x- h) g(x) 
| Jeth)g60)- fea) fe) g(x) - fx) gc h) 
g(x * h) g(x) 
. EOS Ge h) -fa -Sea 1) - gw} 
g(x) gGx n) 
_ gx) AQ) - f(x) Ag(x) 
g(x) gGx  h) 


(ii) We have, 
A {log f(x)} = logi (x + h)j — log {f(x)} 


log Lt _ 1, of eee ff] 
x) f(x) 


Differences of a Polynomial 
We now look at the differences of various orders of a polynomial of degree n, 
given by 

y= f(x) =a,x" ta, x"! t a, x"? +..44X4+a, 

The first order forward difference is defined by, 

Af (x) = f(x h) - f(x) andis given by, 


Ay 7 a, ((x - hb)" 2 x") dr a, (x - 5h) x" a (xh — x) 


GE 2 


=a, {n h x!  ——— hx"? e.a, inh x"? +...3 


= p. — 


where the coefficients of various powers of x are collected separately. 

Thus, the first order difference of a polynomial of degree n is a polynomial of 
degree n — 1, with 5, , =a,.nh 

Proceeding as above, we can state that the second order forward difference 
ofa polynomial of degree n is a polynomial of degree n —2, with coefficient of x" 


“as n(n-1)h/a,. 


Continuing successively, we finally get A" y = a,n!h", a constant. 


We can conclude that for polynomial of degree n, all other differences having 
order higher than n are zero. 


It may be noted that the converse of the above result is partially true and 
suggests that if the tabulated values of a function are found to be such that the 
differences of the Ath order are approximately constant, then the highest degree of 
the interpolating polynomial that should be used is k. Since the tabulated data may 
have round-off errors, the acutal function may not be a polynomial. 


Example 18: Compute the horizontal difference table for the following data and 
hence, write down the values of V/(4), V? £(3) and V? f(5). 


x 123 4 5 
f(x) 3 18 83 258 627 


Solution: The horizontal difference table for the given data is as follows: 


LO VfG) Vie) Vifo) v*fQ) 


x 

1 3 - - 

2 18 15 - - - 
3 83 65 50 - - 
4 258 175 110 60 x: 
5 627 369 194 84 24 


From the table we read the required values and get the following result: 
Vf (4) 2175, V? f(3) 2 50, V? f(5) = 84 


Example 19: Form the difference table of f(x) on the basis of the following table 
and show that the third differences are constant. Hence, conclude about the degree 
ofthe interpolating polynomial. 


x 012 3 4 
f(x) 5 6 13 32 69 
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Solution: The difference table is given below 


x f(x) AfG) VF) Mf) 


0 5 

1 
1 6 6 

7 6 
2 13 12 

19 6 
3. 32 18 

37 
4 69 


It is clear from the above table that the third differences are constant and 
hence, the degree of the interpolating polynomial is three. 


Newton’s Forward Difference Interpolation Formula 


Newton’s forward difference interpolation formula is a polynomial of degree less 
than or equal to n. This is used to find the value of the tabulated function at a non- 
tabular point. Consider a function y = f(x) whose values y,, y,...., y, at a set of 


equidistant points x,, x,,..., x, are known. 
Let (x) be the interpolating polynomial, such that 
Qx,) = f (x;) =V 
x; =x, +ih, for i=0,1, 2,...,7 (6.36) 
We assume the polynomial (x) to be ofthe form, 
Q(X) = Ay +a (x — x9) +a, (x x)(x- x) +a, (x x(x- x)(x- x,)+ 
eta, (X— xy)x— x). (x xX) 
(6.37) 


The coefficients as in Equation (6.37) are determined by satisfying the 
conditions in Equation (6.36) successively for i — 0, 1, 2,...,n. 


Thus, we get 


yo7«90$)-74,, gives ay 2 y, 


: Xi 7X 
J, = Q(x) — +a (x =X), gives d, Exec am 
A 
a, = 2o 
h 


y, 2965) = a, + a (x, — X) + ax, — x,)x, — x) 


or, Interpolation and 
Approximation 


A 
yo Yo t=" + a,(2h) h 


NOTE 
2933724». A’ y DIS 
LIE GEO 


Proceeding further, we get successively, 


T OA yy T AY 
5-194408 nalh" 


Using these values ofthe coefficients, we get Newton's forward difference 
interpolation in the form, 


E X T7 X (x-x,)(x—x) 2 (x—-X,) (x- X) (x—x;) Ay, 
P) = Yo + A apos TT n n 31 
TNT (x- xy) G@=%) G—x) A" y, 
h h h n! 
This formula can be expressed in a more convenient form by taking u = XT as 
shown here. 
We have, 
x-x, X-(xyth) x-x icu 
h h h 
x-xX, x-(xQ*2h) x-x, RN 
h h h 
X-X x—-ixy*t(n-Dhj  x-xg E 
h h h 
Thus, the interpolating polynomial reduces to: 
u(u -1 u(u—1)\(u—2 
Q(u) = Yo +u Ay, £O Da y, MEI 0 
u(u—Y(u—2).(u—-n-41),, 
Teck A'y, (6.38) 


n : 


This formula is generally used for interpolating near the beginning ofthe table. 
Fora given x, we choose a tabulated point as x, for which the following condition 
is satisfied. 


For better results, we should have 
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The degree ofthe interpolating polynomial to be used is less than or equal to 
NOTES n and is determined by the order ofthe differences when they are nearly same so 
that the differences of higher orders are irregular due to the propagated round-off 

error in the data. 


Newton's Backward Difference Interpolation Formula 


Newton's forward difference interpolation formula cannot be used for interpolating 
at a point near the end of a table, since we do not have the required forward 
differences for interpolating at such points. However, we can use a separate formula 
known as Newton's backward difference interpolation formula. Let a table of 
values {x,y}, fori 0, 1, 2, ..., for equally spaced values of x, be given. Thus, 
x,—x, t ih, y, — f(x), for i — 0, 1, 2, ..., n are known. 

We construct an interpolating polynomial of degree n ofthe form, 


y B Q(x) - by *b(x-x,) +b,(x- ex X, a4) +.. +b, OC E RYE, D x) 
(6.39) 
We have to determine the coefficients b,, b, ..., b. by satisfying the relations, 


O(x,)=y, for i=n,n-1,n-2,...,1,0 


(6.40) 
Thus, Q(x, ) = Vno gives by = Yn (6.41) 
Similarly, (x,_1) = Vn-1 gives Yna = by + b, (x, 5 x,) 
Yn = XA Vy 
O b. P d E i ER 42 
$ LEE (642) 
Again 
Pn) = Yn gives y, = Dy *b(x, = Xp) eb, ,—7x,)x, 47x.) 
On — Xa cx 872 21 (2h) e b ORCI) 
m Jut zy ty, = V^y, 
Ac 2h? EPITZ SN 
By induction or by proceeding as mentioned earlier, we have 
SX ui. cR ons MED 2o Vy, 
Ber V ATE O ae (6.44) 


Substituting the expressions for b, in Equation (6.39), we get 


V^y, Y 
21 pa x) (x Nate pe x, x —x, eK — x) 
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Q(x) 2 y, + M (x—x,)4 


This formula 1s known as Newton's backward difference interpolation formula. in Ce ion ia 
. . . . roximation 
It uses the backward differences along the backward diagonal in the difference D 
table. 


Introducing a new variable v =~ I NOTES 
we have, et eG a ee 
Similarly, ~~? 2,42,,, ~“L=ven-l, 


Thus, the interpolating polynomial in Equation (6.45) may be rewritten as, 


T +D Vy, + v(v 2 2) Vy as v(v - 1v + 2e +n-l) 


Q(x) = y, + wy, + V"y, 


(6.46) 


This formula is generally used for interpolation at a point near the end ofa 
table. 


The error in the given interpolation formula may be written as, 
E(x) = f(x) - e(x) 


2G x) T xa) GT xx 7x) "(8 


where x,<& < x 
(n+l)! pee m 


= v(v+1)(v + 2)...(v + IT Dr 


Extrapolation 


The interpolating polynomials are usually used for finding values ofthe tabulated 
function y = f(x) for a value of x within the table. But, they can also be used in 
some cases for finding values of f(x) for values of x near to the end points x, or x, 
outside the interval [x x]. This process of finding values of f(x) at points beyond 
the interval is termed as extrapolation. We can use Newton's forward difference 
interpolation for points near the beginning value x,. Similarly, for points near the 
end value x , we use Newton's backward difference interpolation formula. 


Example 20: With the help of appropriate interpolation formula, find from the 
following data the weight of a baby at the age of one year and of ten years: 


Age-x 35 7 9 
Weight = y (kg) 5 8 12 17 


Solution: Since the values ofx are equidistant, we form the finite difference table 
for using Newton's forward difference interpolation formula to compute weight of 
the baby at the age of required years. 
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3 5 
3 
NOTES ne l 
4 
7 12 1 
5 
9 17 
Taking x =2, u= a =-0.5. 


Newton’s forward difference interpolation gives, 


~0.5\(-1. 
yatxci, y(l) =5-0.5x3+ C094 


=5-1.5+0.38 = 3.88 23.9 kg. 
Similarly, for computing weight ofthe baby at the age often years, we use 
Newton's backward difference interpolation given by, 


x-x, 10-9 | 


n 


h 2 


0.5 


0.5x1.5 
x 


y at x=10, y(10) =17+0.5x5+ 1 


=174+2.5+0.38=19.88 


Inverse Interpolation 


The problem of inverse interpolation in a table of values of y =f (x) is to find the 
value of x for a given y. We know that the inverse function x = g (y) exists and is 


unique, if y — f (x) is a single valued function of x and g exists and does not 
X 


vanish in the neighbourhood ofthe point where inverse interpolation is desired. 


When the values of x are unequally spaced, we can apply Lagrange's 
interpolation or iterative linear interpolation simply by interchanging the roles of x 
and y. Thus Lagrange's formula for inverse interpolation can be written as, 


x= U(x, 
i=0 


Wher LW) - Tto -»)/6 2») 
When x values are equally spaced, we can apply the method of successive 
approximation as described below. 


Consider Newton's formula for forward difference interpolation given by, 


u(u —l1)(u-2) A3 


3! yo te. 


u(u —1) 2 
= yo +u Ayo t ————— A yg + 
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Retaining only two terms on the RHS, we can write the first approximation, h dv in e and 
Ipproximation 


1 
@ _ 
oS — QU aJ 
A yo 
The second approximation can be written as, NOTES 
l uw -1) 
(2) _ 2 
u A 
I lo Yo) 5 Yo 


on replacing u by uw” in the coefficient of A? yọ. 


Similarly, the third approximation can be written as, 


1 u(y a uo (u® = Nu” -2) 
(3) _ x Xd 
u Ay, b Yo 2 Yo 6 Yo 
The process can be continued until two successive approximations have a 
reasonable accuracy. Then x is obtained by the relation, 
x=x, tuh 
Example 21: Using inverse interpolation, find the value of x for y = 5, from the 
given table. 
x 1 3 4 
y 3 12 19 


Solution: Applying inverse interpolation, 


2 
x= $ hi) 
i=0 
Thus, for y=5, we have 


=- 19-126-19).1, (5—3)(5—19) x34 (5—3)(5-12) zd 
(3—-12)(3 -19) (12—3)(12 -19) (19 —3)(19 - 12) 
7x14 2x-14 2x-7 

= + —— x3 + x 


= 4 
9x16 9x-7 16x7 

= 0.6805 + 1.3333 — 0.5000 

21.5138 


=1.514 correct upto four significant figures. 


Example 22: Given the following tabular values of cosh x, find x for which 
cosh x = 1.285. 


x 0.738 0.739 0.740 0.741 0.742 
cosh. x 1.2849085 1.2857159 1.2865247 1.2873348 1.2881461 
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pci. and Solution: Since finding x for an equally spaced table of cosh x is a problem of 
RHET inverse interpolation, we employ the method of successive approximation using 
Newton's formula of inverse interpolation. We first form the finite difference table. 


NOTES x  f(x)scoshx Af(x) A’f(x) A f(x) 
0.738 1.2849085 


8074 
0.739 = 1.2857159 14 

8088 -1 
0.740 | 1.2865247 13 

8101 -1 
0.741  1.2873348 12 

8113 


0.742  1.2881461 


Using Newton's forward difference interpolation formula for the first 


(x= xo) 


approximation u = we get, 

1 
O (y= 
= y-») 
MO) UU 
For, y =1.285, we take x, = 0.739. 
1 
u = — — — x (1,285 —1.2857159) = —0.8851384, then x ~ 0.739885 

0.0008088 


For a second approximation, 


Q) _ 40 L i ted) A’ f (x) 
Af (xy) 2 
= —0.8851384 l x (—0.8851384) x (—1.8851384) x 0.0000013 
0.0008088 x 2 
= —0.885 1384 — 0.0013409 = —0.8864793 => x = 0.7398864 
Similarly, 


(3) 


(1) u P (u® =1) AT 1 u (u C 2) A f, 
2 Af, 6 Af, 

= —0.8851384 — 0.0013430 — 0.000073600 

= —0.886555 => x = 0.7398865 


u =u 


Example 23: Find the divided difference interpolation for the following table of 
values: 


x 4 7 9 
f(x) -43 83 327 
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Solution: We first form the Divided Difference (DD) table as given below. Interpolation and 
Approximation 


x f(x) Ist DD 2nd DD 


4 -43 

42 NOTES 
7 83 16 

122 
9 327 


Newton’s divided difference interpolation formula is, 


F(X) = fos) G x) fH. x) x 7x) (7x) f x x. x] 
Af (x) = -43 + (x — 4) 42 + (x — 4) (x - T) x16 
-16x? -134x + 237 


Example 24: Given the following table of values ofthe function y = log, x, construct 


the Newton's forward difference interpolating polynomial. Comment on the degree 
ofthe polynomial and find log 1001. 


x 1000 1010 1020 1030 1040 
log. x 3.00000 3.00432 3.00860 3.01284 3.01703 


Solution: We form the difference table as given below: 


x y Ay Ny 
1000 3.00000 
432 
1010 3.00432 -4 
428 
1020 3.00860 -4 
424 
1030 3.01284 -5 
419 


1040 3.01703 


We observe that, the differences of second order are nearly constant. Thus, 
the degree ofthe interpolating polynomial is 2 and is given by, 


-1 
Y = yo t uAy, Day, where u =~ 


Xo 


For x = 1001, we take x, = 1000. 
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Interpolation and 
Approximation 1001—1000 
Sp = — = 
10 


log, 1001 = 3.00000 + 0. 1 x 0.00432 + 


0.1 


94 = x (-0.00004) 


NOTES 
= 3.000430 ~ 3.00043 


Example 25: Determine the interpolating polynomial for the following data table 
using both forward and backward difference interpolating formulae. Comment on 
the result. 


x 0 1 2 3 4 
f(x) 1.0 8.5 360 95.5 1990 


Solution: Since the data points are equally spaced, we construct the Newton’s 
forward difference interpolating polynomial for which we first form the finite 
difference table as given below: 


x f(x) AQ) MfG) ASO) 


0 1.0 

7.5 
10 $85 20.0 

27.5 12.0 
2.0 36.0 32.0 

59.5 12.0 
3.0 95.5 44.0 

103.5 
4.0 199.0 


Since the differences of order 3 are constant, we construct the third degree 
Newton's forward difference interpolating polynomial given by, 


f(a) 2102x054 30,39, 28-08-91 


Since x, 2-0, h=1.0 


Le,  f(x)-10-«1.5x - Ax! +2x°, on simplification. 


Taking x, =4, we also construct the backward difference interpolating 
polynomial given by, 
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Interpolation and 
ou NS Approximation 
(x-4) (x 3). 44 
2 
(x-4 (x-3) (x-3) 
j r x12 NOTES 


-1.041.5x - Ax? + 2x? , on simplification. 


f(x) 2199 + (x — 4)x103.54 


This is the same as the forward difference interpolating polynomial, because 
the difference ofthird order is constant. 


Example 26: Use Newton's divided difference interpolation to evaluate f(18) 
and f (12) for the following data: 


x 4 5 7 a I B 
f(x) 48 100 294 900 1210 2028 


Solution: We first form the divided difference table as given below. 


El 


f(x) Is DD 2nd DD 3rd DD 


4 48 

52 
5 100 15 

97 1 
7 294 21 

202 1 
10 900 27 

310 1 
11 1210 33 

409 
13 2028 


Since 3rd order divided differences are same, higher order divided differences 
vanish. We have the Newton’s divided difference interpolation given by, 


f(x) = fo +(x- xf [x. x |+ G xox xf [xy x). x; | 
tx - x) - x) - x) f [x Xp, X5, x] 


For x = 8, we take x, = 4, 


f(8) =48 + (8 — 4)52 + (8 4(8—5) x154- (8- 48—5)(8— 7) x1 
= 48 + 208 4180 +12 = 448 


For x = 12, we take x, = 13, 


f 2) = 2028 + (12 -13)x 409 + (12-13) (12-11) x33 
* (12-13) (12-11) (12-10)x1 
-. f (12) = 2028- 409-33- 2 21584 
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Interpolation and Example 27: Using inverse interpolation, find the zero of f(x) given by the following 
Approximation 
tabular values. 


x 03 04 06 07 
NOTES y=f(x) 0.14 0.00 —0.04 -0.06 


Solution: Using Lagrange’s form of inverse interpolation, we calculate the formula 
using y — 0. 14, 0.06, — 0.04 and — 0.06, as given below: 


(y — 0.06) y + 0.04)(y + 0.06) 
(0.14 — 0.06)(0.14.-- 0.04)(0.14 + 0.06) 
(y -0.14)(y + 0.04)(y + 0.06) 
(0.06 — 0.14)(0.06 + 0.04)(0.06 0.06) ` 
(y -0.14)(y — 0.06)(y + 0.06) 
(0.04 —0.14)(0.04 — 0.06)(—0.04 +0.06) - 
(y —0.14)(y — 0.06)(y + 0.04) 
(-0.06 — 0.14)(—0.06 — 0.06)(—0.06 + 0.04) ` 


PB(y)= 


—0.06 x 0.04 x 0.06 x 0.3 " 0.14 x 0.04 x 0.06 x 0.4 
0.08 x 0.18 x 0.20 0.08 x 0.1x 0.12 
0.14x0.06x0.06x0.6 0.14x 0.06 x 0.04 x 0.7 


Thus, P(0)= 


0.18 x 0.1x 0.02 0.2 x 0.12 x 0.02 
= —0.015 +0.14 + 0.84 — 0.49 = 0.475 


Thus, the zero of f(x) is 0.475 which is approximately equal to 0.48, since the 
accuracy depends on the accuracy ofthe data which is the significant digits. 


Hermite Interpolation 


Hermite Interpolation: Hermite interpolation, named after Charles Hermite, is 
a method of interpolating data points as a polynomial function. The generated 
Hermite interpolating polynomial is closely related to the Newton polynomial, in 
that both are derived from the calculation of divided differences. However, the 
Hermite interpolating polynomial may also be computed without using divided 
differences, see Chinese remainder theorem and Hermite interpolation. 


Unlike Newton interpolation, Hermite interpolation matches an unknown 
function both in observed value, and the observed value of its first m derivatives. 
This means that n(m + 1) values, 


(zo; wc). (z1, 2 hi "t 53 (24-15 05-3 ja 


(2^0 , c); (21,24 h "3 (25 hiduh 


(m) 4 (m) ) ( (m) 


(ro, yo ) (T1; Tr 1: Yn-1 
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must be known, rather than just the first n values required for Newton Interpolation and 
interpolation. The resulting polynomial may have degree at most n(m + 1) — 1, i dud 
whereas the Newton polynomial has maximum degree n — 1. (In the general case, 
there is no need for m to be a fixed value; that is, some points may have more 
known derivatives than others. In this case the resulting polynomial may have NOTES 
degree N — 1, with N the number of data points.) 


Check Your Progress 


. What do we generate in iterative linear interpolation? 

. Define interpolation. 

. Howis Lagrange's interpolation useful? 

. Which interpolation will you use for equally spaced tabular values? 
. Definethe shift operator. 

. Whatisthe Newton forward difference interpolation formula used? 


. Define extrapolation. 


coo N QV tn FW NY — 


. Define the problem of inverse interpolation. 


= 
G2 


ANSWERS TO CHECK YOUR PROGRESS 
QUESTIONS 


1. In this method, we successively generate interpolating polynomials of any 
degree by iteratively using linear interpolating functions. 


2. Itcan be stated explicitly as “given a set of (n + 1) values y, Y,» y... y, for 
X =X p X,,X,, ..., X, respectively. The problem of interpolation is to compute 
the value of the function y =f (x) for some non-tabular value of x.’ 

3. Lagrange's interpolation is useful for unequally spaced tabulated values. 

4. For interpolation of an unknown function when the tabular values ofthe 
argument x are equally spaced, we have two important interpolation 
formulae, viz., 

(a) Newton's forward difference interpolation formula 
(b) Newton's backward difference interpolation formula 

5. The shift operator is denoted by E and is defined by E f(x) 7 f'(x +h). 

6. The Newton's forward difference interpolation formula is a polynomial of 
degree less than or equal to n. 


7. The interpolating polynomials are usually used for finding values of the 
tabulated function y = f(x) for a value ofx within the table. But they can also 
be used in some cases for finding values of f(x) for values of x near to the 
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ODA and end points x, or x, outside the interval [x,, x,]. This process of finding 
t if E b = 
a values of f(x) at points beyond the interval is termed as extrapolation. 


8. The problem of inverse interpolation in a table of values of y = f (x) is to 


NOTES find the value ofx for a given y. 


6.4 SUMMARY 


e The problem of interpolation is very fundamental problem in numerical 
analysis. 
e [n numerical analysis, interpolation means computing the value of a function 
f (x) in between values of x in a table of values. 


e Lagrange's interpolation is useful for unequally spaced tabulated values. 


e For interpolation of an unknown function when the tabular values of the 
argument x are equally spaced, we have two important interpolation 
formulae, viz., Newton’s forward difference interpolation formula and 
Newton’s backward difference interpolation formula. 


e The forward difference operator is defined by, Af (x) = f(x+h)- f(x). 
e The backward difference operator is defined by, Af(x) = f(x+h)— f(x). 


e We define different types of finite differences such as forward differences, 
backward differences and central differences, and express them in terms of 
operators. 


e The shift operator is denoted by E and is defined by E f (x) ^ f (x + h). 


e The first order difference of a polynomial of degree n is a polynomial of 
degree n—1. For polynomial of degree n, all other differences having order 
higher than n are zero. 


e Newton's forward difference interpolation formula is generally used for 
interpolating near the beginning ofthe table while Newton's backward 
difference formula is used for interpolating at a point near the end ofa table. 


e [n iterative linear interpolation, we successively generate interpolating 
polynomials, of any degree, by iteratively using linear interpolating functions. 

e The process of finding values of a function at points beyond the interval is 
termed as extrapolation. 


e The problem of inverse interpolation in a table of values of y = f(x) is to 
find the value of x for a given y. 


6.5 KEY WORDS 


e Interpolation: It means computing the value ofa function f(x) in between 


values of x ina table of values. 
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Interpolation and 


e Extrapolation: The process of finding values ofa function at points beyond Appeccination 


the interval is termed as extrapolation. 


6.6 SELF ASSESSMENT QUESTIONS AND NOTES 
EXERCISES 


Short-Answer Questions 


1. What is the significance of polynomial interpolation? 
2. Define the symbolic operators E and A. 
3. What is the degree of the first order forward difference of a polynomial of 
degree n? 
4. What is the degree of the nth order forward difference of a polynomial of 
degree n? 
. Write Newton's forward and backward difference formulae. 


5 
6. State an application of iterative linear interpolation. 
7. Whatis the advantage of extrapolation? 

8 


. State Lagrange's formula for inverse interpolation. 
Long-Answer Questions 


1. Use Lagrange's interpolation formula to find the polynomials of least degree 
which attain the following tabular values: 


x =>, d 2 
y 25 -8 -15 


(a) 


x 0 L1.2. 5 
y 2 3 12 147 


(b) 


x 1 2 34 
yecb ef od 


(c) 


2. Form the finite difference table for the given tabular values and find the 
values of: 


(a) Af (2) 
(b) Af*() 
(c) Af*(0) 
(d) Af*() 
(e) f5) 
(f f (3) 
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Interpolation and 


Approximation x 0 T 2 3.4 5 6 


f(x) 3 4 13 36 79 148 249 


3. How are the forward and backward differences in a table related? Prove 
NOTES the following: 


(a) Ay, = Vy; 
(b) A? y, Vy 


(c) A" y, = V3. 
4. Describe Newton's forward and backward difference formulae using 
illustrations. 
5. Explain iterative linear interpolation with the help of examples. 


6. Illustrate inverse interpolation procedure. 
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UNIT7 APPROXIMATION 


Structure NOTES 
7.0 Introduction 
7.1 Objectives 
7.2 Approximation 
7.3 Least Square Approximation 
7.4 Answers to Check Your Progress Questions 
7.5 Summary 
7.6 Key Words 
7.7 Self Assessment Questions and Exercises 
7.8 Further Readings 


7.0 INTRODUCTION 


Numerical error is the combined effect oftwo kinds of error in a calculation. The 
first is caused by the finite precision of computations involving floating point or 
integer values. The second usually called truncation error is the difference between 
the exact mathematical solution and the approximate solution obtained when 
simplifications are made to the mathematical equations to make them more 
amenable to calculation. The number of significant figures in a measurement, such 
as 2.531, is equal to the number of digits that are known with some degree of 
confidence (2, 5 and 3) plus the last digit (1), which is an estimate or approximation. 
Zeroes within a number are always significant. Zeroes that do nothing but set the 
decimal point are not significant. Trailing zeroes that are not needed to hold the 
decimal point are significant. A round-off error, also called rounding error, is the 
difference between the calculated approximation of a number and its exact 
mathematical value. Numerical analysis specifically tries to estimate this error when 
using approximation equations and/or algorithms, especially when using finitely 
many digits to represent real numbers. 


In this unit, you will study about the approximation and least square 
approximation. 


7.1 OBJECTIVES 


After going through this unit, you will be able to: 
e Explain the various types of approximations 
e Evaluate errors in functions 
e Define significance errors 
e Understand the characteristics of numerical computation 


e Analyse the least square approximation Self-Instructional 
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Approximation 
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NOTES 
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7.2 APPROXIMATION 


Numerical methods are methods used for solving problems through numerical 
calculations providing a table of numbers and/or graphical representations or figures. 
Numerical methods emphasize that how the algorithms are implemented. Thus, 
the objective of numerical methods is to provide systematic methods for solving 
problems in a numerical form. Often the numerical data and the methods used are 
approximate ones. Hence, the error in a computed result may be caused by the 
errors in the data or the errors in the method or both. Generally, the numbers are 
represented in decimal (base 10) form, while in computers the numbers are 
represented using the binary (base 2) and also the hexadecimal (base 16) forms. 
To perform a numerical calculation, approximate them first by a representation 
involving a finite number of significant digits. If the numbers to be represented 
are very large or very small, then they are written in floating point notation. The 
Institute of Electrical and Electronics Engineers (IEEE) has published a standard 
for binary floating point arithmetic. This standard, known as the IEEE Standard 
754, has been widely adopted. The standard specifies formats for single precision 
and double precision numbers. The simplest way of reducing the number of 
significant digits in the representation ofa number is simply to ignore the unwanted 
digits known as chopping. All these topics are discussed in the following section. 


Significant Figures 


In approximate representation of numbers, the number is represented with a finite 
number of digits. All the digits in the usual decimal representation may not be 
significant while considering the accuracy of the number. Consider the following 
numbers: 

1514, 15.14, 1.324, 1524 


Each ofthem has four significant digits and all the digits in them are significant. 
Now consider the following numbers, 
0.00215, 0.0215, 0.000215, 0.0000125 


The leading zeroes after the decimal point in each ofthe above numbers are 
not significant. Each number has only three significant digits, even though they 
have different number of digits after the decimal point. 


Floating Point Computation 


Every real number is usually represented by a finite or infinite sequence of decimal 
digits. Thisis called decimal system representation. For example, we can represent 


1 1 1 
3 as 0.25, but 3 as 0.333... Thus A is represented by two significant digits only, 


m tle — T 
while 315 represented by an infinite number of digits. Most computers have two 


forms of storing numbers for performing computations. They are fixed-point and 
floating point. In a fixed-point system, all numbers are given with a fixed number of 
decimal places. For example, 35.123, 0.014, 2.001. However, fixed-point 
representation is not of practical importance in scientific computation, since it cannot 
deal with very large or very small numbers. 


In a floating-point representation, a number is represented with a finite 
number of significant digits having a floating decimal point. We can express the 
floating decimal number as follows: 


623.8 as 0.6238 x 10?, 0.0001714 as 0.1714 x 10? 


A very large number can also be representated with floating-point 
representation, keeping the first few significant digits such as 0.14263218 x 10?. 
Similarly, a very small number can be written with only the significant digits, leaving 
the leading zeros such as 0.32192516 x 1079. 


In the decimal system, very large and very small numbers are expressed in 


scientific notation as follows: 4.69 x10? and 1-601x10 ?. Binary numbers can 
also be expressed by the floating point representation. The floating point 
representation ofa number consists of two parts: the first part represents a signed, 
fixed point number called the mantissa (m); the second part designates the position 
ofthe decimal (or binary) point and is called the exponent (e). The fixed point 
mantissa may be a fraction or an integer. The number of bits required to express 
the exponent and mantissa is determined by the accuracy desired from the computing 
system as well as its capability to handle such numbers. For example, the decimal 
number + 6132.789 is represented in floating point as follows: 


sign sign 
0 0.6132789 0 04 
SY 

mantissa exponent 


The mantissa has a 0 in the leftmost position to denote a plus. Here, the 
mantissa is considered to be a fixed point fraction. This representation is equivalent 
to the number expressed as a fraction 10 times by an exponent, that is 
0.6132789 x 10***. Because of this analogy, the mantissa is sometimes called the 

fraction part. 


Consider, for example, a computer that assumes integer representation for 
the mantissa and radix 8 for the numbers. The octal number + 36.754 = 36754 x 
8? in its floating point representation will look like this: 


sign sign 
0 36754 1 03 
mantissa exponent 


When this number is represented in a register in its binary-coded form, the 
actual value of the register becomes 0011 110 111 101 100 and 1 000 011. 


Approximation 


NOTES 
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Approximation Most computers and all electronic calculators have a built-in capacity to 


perform floating-point arithmetic operations. 
Example 1: Determine the number ofbits required to represent in floating point 
NOTES notation the exponent for decimal numbers in the range of 10556. 


Solution: Let n be the required number of bits to represent the number 10796, 


2" 10" 
nlog2 = 86 
n= 29 = s = 285.7 
log2 0.3010 


Therefore, 10**° 22257 


The exponent +285 can be represented by a 10-bit binary word. It has a 
range of exponents (+511 to —512). 


Errors in Numerical Solution 


The errors in a numerical solution are basically of two types. They are truncation 
error and computational error. The error which is inherent in the numerical method 
employed for finding numerical solution is called the truncation error. The 
computational error arises while doing arithmetic computation due to representation 
of numbers with a finite number of decimal digits. 


The truncation error arises due to the replacement of an infinite process 
such as summation or integration by a finite one. For example, in computation of a 
transcendental function we use Taylor series/Maclaurin series expansion but retain 
only a finite number of terms. Similarly, a definite integral is numerically evaluated 
using a finite sum with a few function values of the integral. Thus, we express the 
error in the solution obtained by numerical method. 


Inherent errors are errors in the data which are obtained by physical 
measurement and are due to limitations of the measuring instrument. The analysis 
of errors in the computed result due to the inherent errors in data is similar to that 
of round-off errors. 


Generation and Propagation of Round-Off Error 


During numerical computation on a computer, a round-off error is generated by 
taking an infinite decimal representation of a real, rational number such 
as 1/3, 4/7, etc., by a finite size decimal form. In each arithmetic operation with 
such approximate rounded-off numbers there arises a round-off error. Also round- 
offerrors present in the data will propagate in the result. Consider two approximate 
floating point numbers rounded-offto four significant digits. 

x = 0.2234 x 10? and y = 0.1112 x 10? 
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The sum x + y = 0.23452 x 10? is rounded-off to 0.23456 x 10? with an Approximation 
absolute error, 2 x 10?. This is the new round-off error generated in the result. 
Besides this error, the result will have an error propagated from the round-off 


errors in x and y. 
NOTES 
Round-Off Errors in Arithmetic Operations 


To getan insight into the propagation of round-off errors, let us consider them for 
the four basic operations of addition, subtraction, multiplication and division. Let 
x, and y, be two real numbers whose round-off errors in their approximate 
representations x and y are €, and e, respectively, so that 

Xp=xte, and y,-2y-t£, 


Their addition gives, (x, + y,) 2 (x - y) - € +£, 


Hence, the propagated round-off error is given by, 
(xr t yr)- xt y) 2 € + € 
Thus the propagated round-off error is the sum of two approximate numbers 


(having round-off errors) equal to the sum of the round-off errors in the individual 
numbers. 


The multiplication oftwo approximate numbers has the propagated round- 
offerror given by, 

Xp X Vp — Xy =E VY t £X t £j£; 

Since the product €,€, is a small quantity of higher order, then £, or €, may 
take the propagated round-off error as e,x, 4 e, y, and the relative propagated 
error is given by, 

£&XE,y € | €; 
Xy x y 
This is equal to the sum of the relative errors in the numbers x and y. 


Similarly, for division we get the relative propagated error as, 


Thus, the relative error in division is equal to the difference of the relative 
errors in the numbers. 


Errors in Evaluation of Functions 


The propagated error in the evaluation of a function f(x) ofa single variable x 
having a round-off error £ is given by, 


f(x*e)-f(x)ee f(x) 
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Approximation In the evaluation of a function of several variables x,, x,, ..., x,, the 


propagated round-off error is given by > £ ra where €,, £,...., £, are the round- 
IX 


i=] i 


NOTES off errors in x,,x,,...,.X,, respectively. 


Significance Errors 


During arithmetic computations of approximate numbers having fixed precision, 
there may be loss of significant digits in some cases. The error due to loss of 
significant digits is termed as significance error. Significance error is more serious 
than round-off errors, since it affects the accuracy of the result. 


There are two situations when loss of significant digits occur. These are, 
(i) Subtraction of two nearly equal numbers. 


(ii) Division by a very small divisor compared to the dividend. 


For example, consider the subtraction of the nearly equal numbers 
x =0.12454657 and y = 0.12452413, each having eight significant digits. The 
result x — y =0.22440000 x 10%, is correct to four significant figures only. This 
result when used in further computations leads to serious error in the result. 
Consider the problem of computing the roots ofthe quadratic equation, 
ax’ + bx+c=0 


The roots of this equation are, 


—b * Nb? — 4ac and -b - Nb —4ac 


2a 2a 


If 5? >> 4ac, then the evaluation of —b + J^? — 4ac leads to subtraction of 
nearly equal numbers. One can avoid this by rewriting the expression, 


-b+ Nb? —4ac 
2a 


It can be written as, 


( b+ b? -AacY-b - JP? 4ac) is 
2ax (b - vo -4ac] n b NP? —4ac 


Let the quadratic equation be, 
x? + 100.0001x + 0.01 20 
Using the first formula, we get the smaller root — 0. 10050000 x 10°, whereas 


exact root is 0.10000 0000 x 10°. But using the last expression we get the smaller 
root as 0.10000000 x 10? which does not has the effect of significance error. 


Consider an example where loss of significant digits occur due to division 
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. —COS xX 
Computation of f(x) =——5—. for small values of x would have loss of 

X 


significant digits. 
The Table 7.1 shows the computed values of f(x) upto six decimal places NOTES 
along with the correct values and error. 


Table 7.1 Computed Value of f(x) upto Six Decimal Places 


x Computed f(x) | Correct f(x) Error 
0.1 0.499584 0.499583 — 0.000001 
0.01 0.50008 0.499996 — 0.000012 
0.001 0.506639 0.500000 — 0.006639 
0.0001 0.500000 0.745058 0.245058 


Table 7.1 shows that the error in the computed value becomes more serious 
for smaller value of x. It may be noted that the correct values of f(x) can be 
computed by avoiding the divisions by small number by rewriting f (x) as given 
below. 


1-cosx 1+cosx 
= x 


f(x) 7 
X 


14 cosx 


= La 
sin? x 
i.e., f(x)= 


x’ (1+ cos x) 


Characteristics of Numerical Computation 


A numerical solution can never be exact but attempts are made to know the accuracy 
of the approximate solution. Thus one attempts to get an approximate solution 
which differs from the exact solution by less than a specified tolerance limit. 


Some numerical methods find the solution by a direct method but many others 
are of repetitive nature. The first step in the solution procedure is to take an 
approximate solution. Then the numerical method is applied repeatedly to get 
better results till the solution is obtained up to a desired accuracy. This process is 
known as iteration. 


To get a numerical solution on a computer, one has to write an algorithm. An 
algorithm is a sequence of unambiguous steps used to solve a given problem. In 
the design of such computer programs one considers the input data required to 
implement the numerical method and writes the computer program in a suitable 
programming language. The output of the program should give the solution with 
the desired accuracy. 


It may be noted that the iterative method gives rise to a sequence of results. 
The convergence of this sequence to get the output upto a desired accuracy is 
dependent on the initial data. Hence, one has to suitably choose the input data. 
Thus, if for some input data the sequence is not convergent for certain pre-assigned 
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number of iterations then the input data is changed. It is for this reason that one has 
to limit the number of iterations to be employed while designing the computer 
program. 

While computing a solution with the help of an algorithm, one has to check 
the correctness ofthe solution obtained. To do so, one has to have some test data 
whose solution is known. 


Example 2: The numbers 28.483 and 27.984 are both approximate and are 
correct up to the last digits shown. Compute their difference. Indicate how many 
significant digits are present in the result and comment. 


Solution: We have 28.483 — 27.984 = 00.499. The result has only three significant 
digits. This is due to the loss of significant digits during subtraction of nearly equal 
numbers. 

Example 3: Round the number x — 2.2554 to three significant figures. Find the 
absolute error and the relative error. 

Solution: The rounded-off number is 2.25. 


The absolute error is 0.0054. 


The relative erroris ~ 


0.0054 — 0.0004 
2.25 


The percentage error is 0.24 per cent. 


] 22 : 
Example 4: Ift —3.14 instead of EE find the relative error. 


22 22 
Solution: Relative error = | 7 sa) / 2 0.00090. 


Example 5: Determine the number of correct digits in x = 0.2217, if it has a 
relative error £, =0.2x10". 
Solution: Absolute error = 0.2 x 10! x 0.2217 = 0.004434 

Hence, x has only one correct digit x ~ 0.2. 


Example 6: Round-offthe number 4.5126 to four significant figures and find the 
relative percentage error. 


Solution: The number 4.5126 rounded-offto four significant figures is 4.153. 


Relative error  — 9:0004 , 100 — — 0.0088 percent 


4.5126 


. Say : : À 
Example 7: Given f (x, y, z) = ee an , find the relative maximum error in the 
Z 


evaluation of f (x, y, 2 at x = y =z = 1, if x, y, z have absolute errors 
Ax = Ay = Az =0.1 


Solution: The value off (x, y, z) atx =y=z= 1 is 5. The maximum absolute error Approximation 
in the evaluation of f(x, y, z) is, 


Of 4 


+ + 
Be 


NA 
as Za 


f ns 
5y? 


z 


1 
a^ oy a+ 
Z 


£T 2 
EN x 
Z 

At, x=y=z=1, the maximum relative error is, 


25x0.1 
LORS PIS x 5 = 


Example 8: Find the relative propagated error in the evaluation of x + y where 
x= 13.24 and y= 14.32 haveround-offerrors e, = 0.004 and £, = 0.002 respectively. 


0.5 


Solution: Here, x+ y 227.56 and e,+¢€, =0.006. 


; : 0.006 
Thus, the required relative error — 3756 ^ 0.0002177 , 


Example 9: Find the relative percentage error in the evaluation of u = xy with 
x= 5.43, y = 3.82 having round-off errors 0.01 in both x and y. 


Solution: Now, xy = 5.43 x 3.82 ~ 20.74 


The relative error in x is vu = 0.0018. 


. . . 0.01 
The relative error in y is 5a 0.0026. 


Thus, the relative propagated error in x and y = 0.0044. 
The percentage relative error — 0.44 per cent. 


Example 10: Given u = xy + yz + zx, find the estimate of relative percentage 
error in the evaluation of u for x 7 2.104, y= 1.935 and z = 0.845. What are the 
approximate values correct to the last digit? 


Solution: Here, u = x (y + z) + yz = 2.104 (1.935 + 0.845) + 1.935 x 0.845 
= 5.849 + 1.635 = 7.484 
Error, Au = (y + z)Ax + (z + x)Ay +(x + y)Az 
= 0.0005 x 2(x+ y +z) («^ Ax = Ay = Az = 0.0005) 
= 2x 4.884 x 0.0005 = 0.0049 


4 
: x100 = 0.062 per cent. 


Hence, the relative percentage error = 7.884 


Example 11: The diameter ofa circle measured to within 1 mm is d — 0.842 m. 
Compute the area ofthe circle and give the estimated relative error in the computed 


result. 
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2 
Solution: The area ofthe circle A is given by the formula, 4 = x : 


3.1416 


Thus, 4- x (0.842)? m? = 0.5568 m. 


Here the value of x is taken upto 4th decimal palce since the data of d has 
accuracy upto the 3rd decimal place. Now the relative percentage error in the 
above computation is, 


M 2nd x 444 x19 = 2Ad igs 2x0.01 

4 nd d 0.842 
Example 12: The length a and the width b ofa plate is measured accurate up to 
1cm asa = 5.43 m and b —3.82 m. Compute the area of the plate and indicate its 


error. 


= 0.24 per cent 


Solution: The area of the plate is given by, 
A= ab =3.82 x 5.43 sq. m. = 20.74 mr. 


The estimate of error in the computed value of A is given by, 


AA = Aa.b+Ab.a 
= 0.013.82+0.01x5.43, since Aa — Ab = 0.01 
= 0.0925 210 m? 


Computational Algorithms 


For solving problems with the help of a computer, one should first analyse the 
mathematical formulation ofthe problem and consider a suitable numerical method 
for solving it. The next step is to write an algorithm for implementing the method. 
Analgorithm is defined as a finite sequence ofunambiguous steps to be followed 
for solving a given problem. Finally, one has to write a computer program in a 
suitable programming language. A computer program is a sequence of computer 
instructions for solving a problem. 


It is possible to write more than one algorithm to solve a specific problem. 
But one should analyse them before writing a computer program. The analysis 
involves checking their correctness, robustness, efficiency and other characteristics. 
The analysis is helpful for solving the problem on a computer. The analysis of 
correctness of an algorithm ensures that the algorithm gives a correct solution of 
the problem. The analysis of robustness is required to ascertain if the algorithm is 
capable oftackling the problem for possible cases or for all possible variations of 
the parameters ofthe problem. The efficiency is concerned with the computational 
complexities and the total time required to solve the problem. 


Computer oriented numerical methods must deal with algorithms for 
implementation of numerical methods on a computer. The following algorithms of 
some simple problems will make the concept clear. 


Consider the problem of solving a pair of linear equations in two unknowns Approximation 
given by, 


ax by -c, 
a,x+b,y=c, NOTES 


where a,, b, c,, a,, b,, c, are real constants. The solution of the equations are 


given by cross multiplication as, 


Dm b,c, - bc, .oC€00; 7 605 


3. 
a,b, — a,b, a,b, — a,b, 


It may be noted that if a, b, — a, b, = 0, then the solution does not exist. This 
aspect has to be kept in mind while writing the algorithm as given below. 


Algorithm: Solution of a pair of equations aux + by 2 c, a; x+b, y =c, 
Step 1: Read a, b., c,, a,, b,, C, 
Step 2: Compute d — a, b, — a, b, 
Step 3: Check if d — 0, then go to Step 8 else 
go to next step 
Step 4: Compute x 
Step 5: Compute y 
Step 6: Write ‘x =’, x, ‘y =’, y 
Step 7: Go to Step 9 
Step 8: Write ‘no solution’ 
Step 9: Stop 


Example 13: Write an algorithm to compute the roots of a quadratic equation, 
ax’ + bx+c=0. 


Solution: We know that the roots of the quadratic equation are given by, 


E —bx4b? —4ac 


x= 
2a 
Further, if 5? > 4ac, the roots are real, otherwise they are complex conjugates. 


This aspect is to be considered while writing an algorithm. 


Algorithm: Computation of roots ofa quadratic equation. 
Step 1: Read a, b, c 


Step 2: Compute d = b? — 4ac 

Step 3: Check if d > 0, go to Step 4 else go to Step 8 
Step 4: Compute x, = (-b* Vd)/(2a) 

Step 5: Compute x; = (-b -Vd )/(2a) 
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Approximation Step 6: Write ‘Roots are real’, x,, x, 
Step 7: Go to Step 11 


Step 8: Compute x; = V-d /(2a) 
Step 9: Compute x, = —5/(2a) 


NOTES 


Step 10: Write ‘Roots are complex’, ‘Real part — x, ‘Imaginary part =’, x, 
Step 11: Stop 


Check Your Progress 


. What are the two parts of floating point representation? 
. Define truncation and computational errors. 

. Define inherent errors. 

. What is propagated round-off error? 

. What are significance errors? 

. Write the situations when loss of significant digits occur. 


. Why we write an algorithm? 


co N QV tn BW Nel 


. Define features and purpose of computational algorithms. 


7.3 LEAST SQUARE APPROXIMATION 


In this section, we consider the problem of approximating an unknown function 
whose values, at a set of points, are generally known only empirically and are, 
thus subject to inherent errors, which may sometimes be appreciably larger in 
many engineering and scientific problems. In these cases, it is required to derive a 
functional relationship using certain experimentally observed data. Here the 
observed data may have inherent or round-off errors, which are serious, making 
polynomial interpolation for approximating the function inappropriate. In polynomial 
interpolation the truncation error in the approximation is considered to be important. 
But when the data contains round-off errors or inherent errors, interpolation is not 
appropriate. 


The subject ofthis section is curve fitting by least square approximation. Here 
we consider a technique by which noisy function values are used to generate a 
smooth approximation. This smooth approximation can then be used to 
approximate the derivative more accurately than with exact polynomial 
interpolation. 


There are situations where interpolation for approximating function may not 
be efficacious procedure. Errors will arise when the function values f(x), i= 1,2, 


Self-Instructional 
158 Material 


..., N are observed data and not exact. In this case, if we use the polynomial 
interpolation, then it would reproduce all the errors of observation. In such situations 
one may take a large number of observed data, so that statistical laws in effect 
cancel the errors introduced by inaccuracies in the measuring equipment. The 
approximating function is then derived, such that the sum ofthe squared deviation 
between the observed values and the estimated values are made as small as 
possible. 

Mathematically, the problem of curve fitting or function approximation may be 
stated as follows: 


To find a functional relationship y = g(x), that relates the set of observed data 
values P(x, y), i= 1,2,..., nas closely as possible, so that the graph of y= g(x) 
goes near the data points P ’s though not necessarily through all of them. 

The first task in curve fitting is to select a proper form of an approximating 
function g(x), containing some parameters, which are then determined by minimizing 
the total squared deviation. 


For example, g(x) may be a polynomial of some degree or an exponential or 
logarithmic function. Thus g (x) may be any ofthe following: 


(i) g(x) =a+B x (ii) g(x) sa. B x y x? 
(iii) g(x) a e?" (iv) gx) 2a e?* 


(v) g(x) = at log(B x) 

Here æ, B, y are parameters which are to be evaluated so that the curve y= 
g(x), fits the data well. A measure of how well the curve fits is called the goodness 
of fit. 

In the case of least square fit, the parameters are evaluated by solving a system 
of normal equations, derived from the conditions to be satisfied so that the sum of 
the squared deviations ofthe estimated values from the observed values, is minimum. 


Method of Least Squares 


Let (x, f), G5. f)... Œ, J) be a set of observed values and g(x) be the 
approximating function. We form the sums ofthe squares ofthe deviations ofthe 
observed values f, from the estimated values g (x,), 


ie, $= Y -go) 
(7.1) 


The function g(x) may have some parameters, 0, D, y. In order to determine 
these parameters we have to form the necessary conditions for S to be minimum, 
which are: 


Approximation 


NOTES 
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, E -0 
Qm "OB ay (7.2) 


These equations are called normal equations, solving which we get the 


NOTES parameters for the best approximate function g(x). 


Curve Fitting by a Straight Line: Let g(x) = o 4 B x, be the straight line which 
fits a set of observed data points (x, y), i= 1,2, ..., n. 

Let S be the sum ofthe squares ofthe deviations g(x)) — y,, i= 1, 2,...,71, given 
by, 


n 


S= Y (a+Bx,-y,) (7.3) 


i=] 


We now employ the method of least squares to determine ot and D so that S 
will be minimum. The normal equations are, 


S Z 
25 hie (Bx -) -0 (7.4) 
i=l 
And 95 eS 7.5 
, m Pre eel (7.5) 
i=] 
These conditions give, 
nat SB - S, =0 
Sa +S B-S 20 
Where, S, = by So = > s S, = b Sm» X. 
i=] i=l i=l i=l 
Solving, 
a = p = : . Also = Sp, 
-SS +SS, nS,,—-S\S,, nS,- S? n n 


Algorithm: Fitting a straight line y =a + bx. 
Step 1: Read n [n being the number of data points] 
Step 2: Initialize : sum x = 0, sum x? = 0, sum y = 0, sum xy = 0 
Step 3: Forj = 1 ton compute 
Begin 
Read data X, y, 
Compute sum x = sum x + x, 
Compute sum x? + xxx 


Compute sum y= sum y + y, X Y; 
Compute sum xy = sum xy + xXy, 
End 
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Step 4: Compute b = (n X sum xy — sum x X sum y)/ (n x sum x? - (sum xy?) Approximation 
Step 5: Compute x bar = sum x / n 
Step 6: Compute y bar = sum y / n 
Step 8: Compute a = y bar — b x x bar 
Step 9: Write a, b 
Step 10: For7=1 ton 

Begin 


NOTES 


Compute y estimate =a +b x x 
write Xo y, y estimate 
End 
Step 11: Stop 
Curve Fitting by a Quadratic (A Parabola): Let g(x) ^ a + bx + cx’, be the 
approximating quadratic to fit a set of data (x, y.), i = 1, 2, ..., n. Here the 


parameters are to be determined by the method of least squares, i.e., by minimizing 
the sum ofthe squares ofthe deviations given by, 


Sz Y (a bx, tex) -y,) 


i=l 


(7.6) 
Thus the normal equations, gor. 0, go. 0, D». 0, are as follows: 
da db dc 
(7.7) 
Y (at bx, tcx) —y,)=0 
i=l 
Y x(a +bx, cx) —y,)=0 
i=l 
yx (at bx, + 0x7 —y,)=0. (7.8) 
i=l 
These equations can be rewritten as, 
nat+s,b+5s,c—5S,), =90 
$,a+s,b+5s,c—s,, =0 
S,a+58,b+58,C—S,, =0 (7.9) 


n n n 

2 3 4 

where =a, s-XÀX. ssb s-Às 
i-l i-l 


i=l 


$9; = 234 Sı — bs Xi. S85 zy xy (7.10) 
i=l iz i=l 
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Itis clear that the normal equations form a system of linear equations in the 
unknown parameters a, b, c. The computation of the coefficients of the normal 
equations can be made in a tabular form for desk computations as shown below. 


2 

X X y; X X X; Xy; Xy 
2 

X YM MH XS X, MY MY 


2 
2 X, y; X; Xj Xj Xy; X3y 


2 2 
n x JY n x X, X X, X n X, X n 


Sum Si So, Sp $4 S4 Su S21 


The system of linear equations can be solved by Gaussian elimination method. 
It may be noted that number of normal equations is equal to the number ofunknown 
parameters. 


Example 14: Findthe straight line fitting the following data: 


X 4 6 8 10 12 


y, 13.72 12.90 12.001 11.14 10.31 


Solution: Let y — a + bx, be the straight line which fits the data. We have the 


normal equations S eS =0 for determining a and b, where 
a 


ob 


5 
S= 6; -a-bxy, : 
i=l 
5 


Thus, Senses pug 
i=l 


i=l 


5 5 5 
and, > xy, -aX x -bY x, =0 
isl I=1 i=l 


The coefficients are computed in the table below. 


XD; X Xy, 
4 13.72 16 54.88 
6 12.90 36 77.40 
8 12.01 64 96.08 
10 11.14 100 111.40 
12 10.31 144 123.72 

Sum 40 60.08 360 463.48 


Thus the normal equations are, 


5a + 40b — 60.08 = 0 
40a + 360b — 463.48 = 0 


Solving these two equations we obtain, 
a = 15.448, b = 0.429 
Thus, y = g(x) = 15.448 — 0.429 x, is the straight line fitting the data. 


Example 15: Use the method of least square approximation to fit a straight line to 
the following observed data: 


x, 60 61 62 63 64 


L 


y, 40 40 48 52 55 


Solution: Let the straight line fitting the data be y = a + bx. The data values being 
large, we can use a change in variable by substituting u =x — 62 and v — y — 48. 

Let v = A + B u, bea straight line fitting the transformed data, where the 
normal equations for A and are, 


X; Ni u; V; UV; Ui 


60 40 -2 -8 16 4 
61 42 -1 -6 1 
62 48 0 0 0 
63 52 1 4 1 
64 55 2 7 14 4 
Sum 0 -3 40 10 


Thus the normal equations are, 
-3=5A and 40=10B 


Aad and B=4 


This gives the line, y = —3/5+ 4u 
Or, 20u -—Sv—3=0. 
Transforming we get the line, 
20 (x — 62) —5 (v— 48) -3 =0 
Or, 20 x — 5y— 1003 = 0 


Approximation 


NOTES 
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Curve Fitting with an Exponential Curve: We consider a two parameter 
exponential curve as, 


y-ae bx (7.1 1) 
For determining the parameters, we can apply the principle of least squares 
by first using a transformation, 
z=log y, so that Equation (7.11) is rewritten as, (7.12) 
z=loga—bx (7.13) 
Thus, we have to fit a linear curve of the form z=a+f x, withz—x variables 
and then get the parameters a and bas, 


a=", b=-B (7.14) 


Thus proceeding as in linear curve fitting, 
n Y x, log y, - $x; 9. log y, 
B-—ELL sem 
z s 7.15 
S | Ya) (r13) 


And, a = Z — px, where z-(Xs]/z- (Xs 2 (7.16) 
i=l 


i=l 
After computing & and B, we can determine a and b given by Equation (7.13). 
Finally, the exponential curve fitting data set is given by Equation (7.11). 


Algorithm: To fit a straight line fora given set of data points by least square error 
method. 


Step 1: Read the number of data points, i.e., n 
Step 2: Read values of data-points, i.e., Read (x, y.) for i= 1, 2,..., n 


Step 3: Initialize the sums to be computed for the normal equations, 


i.e., sx = 0, sx? = 0, sy = 0, syx ^ 0 
Step 4: Compute the sums, i.e., For i= 1 ton do 
Begin 
SX = SX +X. 
sx = sx TX. 
Sy = Sy t yj 
SYX = SYX + X; y; 


End 


Step 5: Solve the normal equations, i.e., solve for a and b of the line y= a + 
bx 


Compute d=n* SX? — SX * SX Approximation 
b= (n * sxy — sy * sx)/ d 
xbar = sx/n 


ybar = sy/n NOTES 
a = ybar - * x bar 


Step 6: Print values ofa and b 
Step 7: Printa table of values of 


X, Vis Vy =atbx, for i=l, 2, „n 


Step 8: Stop 
Algorithm: To fita parabola y = a+6x+cx’, fora given set of data points by least 
square error method. 

Step 1: Read n, the number of data points 

Step 2: Read (x, y) for i= 1, 2,..., n, the values of data points 


Step 3: Initialize the sum to be computed forthe normal equations, 


i.e., sx = 0, sx? = 0, sx? = 0, sxt = 0, sy = 0, sxy = O. 
Step 4: Compute the sums, i.e., For i= 1 to n do 


Begin 


sy =sy + Y, 
SXy = SXy t Xj; * y, 


SX y 2 sx! y x? * y, 
End 


Step 5: Form the coefficients {a,} matrix ofthe normal equations, i.e., 


2 
d, =n, Gy, =SX, Ay, — 5X 


= ——€— E 
Qj, — 8X, Ay —SX', dy =SX 


Step 6: Form the constant vector of the normal equations. 
b; = sy, b, = sxy, b, = sx y 


Step 7: Solve the normal equation by Gauss-Jordan method 
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diy = 45/4, Ay3 7455 / d, b =b a 


055 = 055 7 05,015; 053 = 493 7 05,013 
b, = b, - ba 
NOTES 035 = 035 70434015 
433 = 433 7 03,033 
b, = b, - bya, 
dy, = 5, | dy, 
b,-b,lay 
433 = 034705340, 
b, = b, — ay, b, 
c = b} / a33 


b=b,-ca,, 
a=b,—ba,,—-ca,, 


Step 8: Print values of a, b, c (the coefficients of the parabola) 
Step 9: Print the table of values of x,, y, and y,, where y,, =a + bx, ^ cx k, 
i.e., print Xp, Y y, for k=l, 2,., m. 


Step 10: Stop. 


Check Your Progress 


9. How is approximating function found in the method of least squares? 


10. Explain the curve fitting by a straight line. 


7.4 ANSWERS TO CHECK YOUR PROGRESS 
QUESTIONS 


1. The floating point representation of a number consists of mantissa and 
exponent. 


2. The errors in a numerical solution are basically of two types. They are 
truncation error and computational error. The error which is inherent in the 
numerical method employed for finding numerical solution is called the 
truncation error. The computational error arises while doing arithmetic 
computation due to representation of numbers with a finite number of decimal 
digits. 

3. Inherent errors are errors in the data which are obtained by physical 
measurement and are due to limitations ofthe measuring instrument. The 
analysis of errors in the computed result due to the inherent errors in data is 
similar to that of round-off errors. 
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. Propagated round-off'error is the sum oftwo approximate numbers (having Approximation 
round-off errors) equal to the sum ofthe round-off errors in the individual 
numbers. 


CA 


. During arithmetic computations of approximate numbers having fixed 
precision, there may be loss of significant digits in some cases. The error 
due to loss of significant digits is termed as significance error. 


NOTES 


6. There are two situations when loss of significant digits occur. These are, 
(i) Subtraction oftwo nearly equal numbers 
(it) Division by a very small divisor compared to the dividend 


- 


. To get a numerical solution on a computer, one has to write an algorithm. 


oo 


. Forsolving problems with the help of a computer, one should first analyse 
the mathematical formulation ofthe problem and considera suitable numerical 
method for solving it. The next step is to write an algorithm for implementing 
the method. 


. Let (x,, f), Qo. f)... ŒJ) bea set of observed values and g(x) be the 
approximating function. We form the sums ofthe squares ofthe deviations 
of the observed values f, from the estimated values g (x,), 


No 


ie, S= (A - Gl 


The function g(x) may have some parameters, 0, D, y. In order to determine 
these parameters we have to form the necessary conditions for S to be 
minimum, which are: 


These equations are called normal equations, solving which we get the 
parameters for the best approximate function g(x). 

10. Let g(x) =a+f6 x, be the straight line which fits a set of observed data 
points (x; y), i= 1, 2, ..., n. 
Let S be the sum of the squares of the deviations g(x.) — y, i= 1, 2,...,7, 
given by, 


S-Y (osx -yy 


7.5 SUMMARY 


e Numerical methods are methods used for solving problems through numerical 
calculations providing a table of numbers and/or graphical representations 
or figures. Numerical methods emphasize that how the algorithms are 


implemented. Self-Instructional 
Material 167 


Approximation * To perform a numerical calculation, approximate them first by a 
representation involving a finite number of significant digits. If the numbers 
to be represented are very large or very small, then they are written in 
floating point notation. 


The Institute of Electrical and Electronics Engineers (IEEE) has published a 
standard for binary floating point arithmetic. 


NOTES 


e [napproximate representation of numbers, the number is represented with 
a finite number of digits. All the digits in the usual decimal representation 
may not besignificant while considering the accuracy ofthe number. 


Ina floating representation, a number is represented with a finite number of 
significant digits having a floating decimal point. 


e Floating point representation ofa number consists of mantissa and exponent. 


e The errors in a numerical solution are basically of two types termed as 
truncation error and computational error. 


The error which is inherent in the numerical method employed for finding 
numerical solution is called the truncation error. 


The truncation error arises due to the replacement of an infinite process 
such as summation or integration by a finite one. 


e Inherent errors are errors in the data which are obtained by physical 
measurement and are due to limitations ofthe measuring instrument. 


e Theanalysis oferrors in the computed result due to the inherent errors in 
data is similar to that of round-off errors. 


e Significance error is more serious than round-off errors. 


Iteration is the numerical method applied repeatedly to get better results till 
the solution is obtained up to a desired accuracy. 


An algorithm is a sequence of unambiguous steps used to solve a given 
problem. 


e [tis possible to write more than one algorithm to solve a specific problem. 


The algorithm analysis involves checking their correctness, robustness, 
efficiency and other characteristics. 


e Single precision floating point format is a computer number format that 
occupies 4 bytes (32-bits) in computer memory and denotes wide range of 
values using a floating point. 


Double precision refers to a specific floating point number that has more 
precision, i.e., more digits to the right of the decimal point than a single 
precision number. 
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7.6 KEY WORDS 


e Truncation error: This erroris inherent in the numerical method employed 
for finding numerical solution. It occurs due to the replacement of an infinite 
process such as summation or integration by a finite one. 


* Computational error: This error occurs during arithmetic computation 
due to representation of numbers having a finite number of decimal digits. 


e Inherent error: This error occurs in the data type which is obtained using 
physical measurement and also due to limitations ofthe measuring instruments. 


e Significance error: This error occurs due to loss of significant digits. 


e Algorithm: It is a sequence of finite steps used to solve a given problem. 


7.7 


SELF ASSESSMENT QUESTIONS AND 
EXERCISES 


Short-Answer Questions 


l. 


Whatare floating point numbers? 


2. Find the percentage error in approximating = by 0.8333 correct upto four 


significant figures. 

3. Write the characteristics of numerical computation. 

4. Find the relative error in the computation of x — y for x = 12.05 and y = 
8.02 having absolute errors Ax = 0.005 and Ay = 0.001. 


5. Find the percentage error in computing y = 3x? —6x atx= 1, ifthe errorin 
x is 0.05. 

6. Givena = 1.135 and b= 1.075 having absolute errors Aa = 0.011 and Ab 
— 0.12. Estimate the relative percentage error in the computation of a — b. 

7. Find the percentage error in taking 1.33 as approximation for 4/3. 

8. The length a and breadth b of a plate measured accurate to 1 cm as a = 
5.43 m and b = 3.82 m. Estimate the area of the plate and estimate its 
absolute error. 

9. How many significant digits are present in each ofthe following approximate 
numbers: 


10.54113, 5.4113, 0.054113, 0.00541 


Approximation 


NOTES 
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Approximation Long-Answer Questions 
1. Round-offthe following numbers to three decimal places: 
(i) 0.230582 (ii) 0.00221118 (iii) 2.3645  (iv)1.3455 
NOTES 2. Round-offthe following numbers to four significant figures: 
(i) 49.3628 (ii) 0.80022 (iii) 8.9325 (iv) 0.032588 
(v) 0.0029417 (vi) 0.00010211 (vii) 410.99 


3. Round-offeach ofthe following numbers to three significant figures and 
indicate the absolute error in each. 


(7) 49.3628 (ii)0.9002 (iii) 8.325 (iv) 0.0039417 

4. Find the sum of the following approximate numbers, correct to the last 
digits. 
0.348, 0.1834, 345.4, 235.2, 11.75, 0.0849, 0.0214, 0.0002435 


5. Find the number of correct significant digits in the approximate number 
11.2461. Given is its absolute error = 0.25 x 10°. 


6. Given are the following approximate numbers with their relative errors. 
Determine the absolute errors. 


(i) x,=12165, €,=0.1% (ii) x, =3.23, £ =0.6% 
(iii) x, = 0.798, £, =10% (iv) x, 2 67.84, £, =1% 
7. Round-offthe following numbers to four significant digits. 
(7) 450.92 (ii) 48.3668 (iii) 9.3265 (iv) 8.4155 
(v) 0.80012 . (vi) 0.042514 (vii) 0.0049125 
(viii) 0.00020215 
8. Write the following numbers in floating-point form rounded to four significant 
digits. 
(7) 100000 (ii) — 0.0022136 (iii) - 35.666 


9. Determine the number of correct digits in the number x in each of the 
following (the relative errors are given). 


(i) x=0.2217, £, =0.2x10" (ii) x =32.541, £, 20.1 
(iii) x = 0.12432, €, =10% (iv) x = 0.58632, £, =1% 


10. Find the percentage error in computing z = yx forx=4.44, ifxis correct 
to its last digit only. 


11. Let u — Ax* + 3x — 9. Find the relative percentage error in computing u at 
x= 1.1, ifthe error in x is 0.05. 
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2 Approximation 


12. In the formula for computing R for R = a 


h : 
7 + 5 find the absolute error in 


computing R for r - 48 mm and h = 56 mm, due to errors of 1 mm in r and 

0.2 mm inh. NOTES 
13. Find the smaller root of 0.0015? + 100. 1x + 10000 = 0, with the help of 

the usual formula and round-offto six significant digits. Compare with the 

correct answer x =—100.0. 


14. Find the roots of the quadratic equation x? — 100x—0.1 — 0, with the help 
of the usual formulae and show the significance error in the result. 
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Numerical Integration and 


Numerical Differentiation (NIT 8 NUMERICAL 
INTEGRATION AND 

NOTES NUMERICAL 
DIFFERENTIATION 


Structure 
8.0 Introduction 
8.1 Objectives 
8.2 Numerical Integration 
8.3 Numerical Differentiation 
8.4 Optimum Choice of Step Length 
8.5 Extrapolation Method 
8.6 Answers to Check Your Progress Questions 
8.7 Summary 
8.8 Key Words 
8.9 Self Assessment Questions and Exercises 
8.10 Further Readings 


8.0 INTRODUCTION 


Numerical integration methods can generally be described as combining evaluations 
of the integrand to get an approximation to the integral. The integrand is evaluated 
at a finite set of points called integration points and a weighted sum of these values 
is used to approximate the integral. The integration points and weights depend on 
the specific method used and the accuracy required from the approximation. 
Modern numerical integrations methods based on information theory have been 
developed to simulate information systems such as computer controlled systems, 
communication systems, and control systems. 


In numerical analysis, numerical differentiation is the process of finding the 
numerical value of a derivative of a given function at a given point. It is the process 
of computing the derivatives of a function f(x) when the function is not explicitly 
known, but the values of the function are known only at a given set of arguments x 
FH 5X X green For finding the derivatives, a suitable interpolating polynomial is 
used and then its derivatives are used as the formulae for the derivatives of the 
function. Thus, for computing the derivatives at a point near the beginning of an 
equally spaced table, Newton’s forward difference interpolation formula is used, 
whereas Newton’s backward difference interpolation formula is used for computing 
the derivatives at a point near the end of the table. 


In this unit, you will study about the numerical integration, numerical 


differentiation and extrapolation method. 
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Numerical Integration and 


8.1 OBJECTIVES Numerical Differentiation 


After going through this unit, you will be able to: 
e Understand the various numerical integrations NOTES 
e Explain aboutthe numerical differentiation 


e Analyse the extrapolation method 


8.2 NUMERICAL INTEGRATION 


The evaluation ofa definite integral cannot be carried out when the integrand f (x) 
is not integrable, as well as when the function is not explicitly known but only the 
function values are known at a finite number of values of x. However, the value of 
the integral can be determined numerically by applying numerical methods. There 
are two types of numerical methods for evaluating a definite integral based on the 
following formula. 


b 
[roo ax (8.1) 


They are termed as Newton-Cotes quadrature and Gaussian quadrature. We 
first confine our attention to Newton-Cotes quadrature which is based on inte- 
grating polynomial interpolation formulae. This quadrature requires a table of val- 
ues ofthe integrand at equally spaced values ofthe independent variable x. 


Newton-Cotes General Quadrature 


We start with Newton's forward difference interpolation formula which uses a 
table of values of f (x) at equally spaced points in the interval [a, 5]. Let the 
interval [a, b] be divided into n equal sub-intervals such that, 


a=x xX, =x tih, fori =1,2,.. mL. x,=b (8.2) 
so that, nh = b-a 
Newton's forward difference interpolation formula is, 


a=) y 4367092 ey " ,S6-DG-2.(57n*D , 
2! i 3! mE 


n! 


T 
(8.3) 


Ps)= fo*s Ah + 


X — Xo 


Where s= ; 


Replacing f(x) by 6 (s) in Equation (8.1), we get 


s(s—l) 
2! 


[re asf] festo fes ds 
Xo 0 


since when x = x $ = 0 and x = x „ s = n and dx = h du. 
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Numerical Integration and Performing the integration on the RHS we have, 


Numerical Differentiation 
n n? fn? n? 2 1{n'4 n? n? 3 
[Adh nfo Ms +5 : Nft EEN 


2 4 3 2 
Xo 
NOTES (n> 34^ 1n? zs 
4 t 3n^ |A fo +... 
24| 5 2 3 


(8.4) 


We can derive different integration formulae by taking particular values of 
n= 1,2,3, .... Again, on replacing the differences, the Newton-Cotes formula can 


be expressed in terms of the function values at x,, x,,..., x. , as 


[rox = AV e fg) 


M k-0 
The error in the Newton-Cotes formula is given by, 
n+2 


Trapezoidal Formula of Numerical Integration 


Taking n = 1 in Equation (8.4), we get the trapezoidal formula given by, 
x, 1 
In i f 2A 


since all other differences of higher order are absent. 


Replacing Af, by f, —/, we have 


| Od Us +f 


Xo 


This is termed as trapezoidal formula of numerical integration. 


(8.5) 


(8.6) 


(8.7) 


This formula can be geometrically interpreted as the definite integral of the 
function f (x) between the limits x, to x,, as is approximated by the area ofthe 
trapezoidal region bounded by the chord joining the points (x,, /,) and (x,, f), the 
x-axis and the ordinates at x — x, and at x — x,. This is represented by the shaded 


area as shown in the Figure 8.1. 
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Numerical Integration and 
Numerical Differentiation 


NOTES 


Xo X 


Fig. 8.1 Trapezoidal Region 


Thus, the area under the curve y = f (x) is replaced by the area under the 
chord joining the points. 
The error in the trapezoidal formula is given by, 


he "(t í h? m 
E, 2 f" ()x f s(s-Dds-— "©, where x, «&«x (8.8) 
0 
Trapezoidal Rule 


For evaluating the integral Í f(x)dx, we have to sum the integrals for each of the 


Xo 


sub-intervals (x,, x,), (x, x,),..., (x, ,, x). Thus, 


n-1? 


[foods = GAME A) tot Poa tf 


t h (8.9) 
Or | f@)de= 7UA +f, t fes f f.] 


This is known as trapezoidal rule of numerical integration. 


The error in the trapezoidal rule is, 


E; = | reod«- i, £20 t fitt fet fl 


MU" 6) P 6) G 


i " 
Where x etx. webs Xa lE, < X, 
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Numerical Integration and Thus. we can write 
Numerical Differentiation : 


he 
12 


k 
E h "et 
TA f°) 


E; --——[nf"($), "© being the mean of f"(5), S” 62)” (S) 


NOTES 


h? 
Where E= = (b-a) f"($) since nh=b-a 
Or, x <<, 


(8.10) 


b 
Algorithm: Evaluation of f f(x)dx by trapezoidal rule. 


Step 1: Define function f (x) 

Step 2: Initialize a, b, n 

Step 3: Compute h = (b-a)/n 

Step 4: Set x =a, S=0 

Step 5: Compute x ^ x +h 

Step 6: Compute S = S'+ f(x) 

Step 7: Check if x < b, then go to Step 4 else go to the next step 
Step 8: Compute / 7 h (S + (f(a) +f (b)y2) 

Step 9: Output J, n 


Simpson's One-Third Formula 


Taking n = 2 in the Newton-Cotes formula in Equation (8.4), we get Simpson’s 
one-third formula of numerical integration given by, 


] ósea Hanae ox? -3x AA] 


=H 24,42 f ( -25 A)| (8.11) 


n [food - SU +4f +h] 


This is known as Simpson’s one-third formula ofnumerical integration. 


The error in Simpson's one-third formula is defined as, 


E,- [re dx - (f, Af +fy) 
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: TES M Numerical Integration and 
Assuming F'(x) = f (x), we obtain: Numerical Differentiation 


Ey = F(x;)- F(%) 3 o * Ah + f) 


Expanding F(x,) = F(x,+2h),f, — f (x,-h) and f, — f (x;-Zh) in powers of 


NOTES 
h, we have: 


E, -2hF'(xj) chy F"(x) a) pera +... 
EE ZU eee py Je ene 2D” prp. 


4 2 Bh, ge 3 
= 2hf, + 2h? fi HÀ Pa Fu aoe: zr y” © 


h , ” n 
R [6f +6hf + AI? f" (0) - 2? f” (0)...] 
5 
Ey = 790 f" (&), on simplification, where x, < $ < x, 
(8.12) 


Geometrical interpretation of Simpson’s one-third formula is that the integral 
represented by the area under the curve is approximated by the area under the 
parabola through the points (x,, f,), (x,, f.) and (x, f,) shown in Figure 8.2. 


Y 


Parabola Y= f(9) 


0 Xo XQ X2 
Fig. 8.2 Simpson 5 One-Third Integration 
Simpson's One-Third Rule 


On dividing the interval [a, b] into 2m sub-intervals by points x, — a, x, — a * h, 
x,—a-t2h,..,x,, — at2mh, where b =x, and h = (b-a)/(Zm), and using 
Simpson's one-third formula in each pair of consecutive sub-intervals, we have 


[reve = [rox Nr row 


= : [fot 4hit Uo Af FO Ua RAF Ot Sama + Asa fas] 


b 
[reo s^ MB EE ELE IIO e EeL EE ES 
Í (8.13) 
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Numerical Integration and This is known as Simpson's one-third rule of numerical integration. 
Numerical Differentiation 


The error in this formula is given by the sum of the errors in each pair of 
intervals as, 


NOTES 2 h? iv iv wet 
i Te GEDHI” (St +A” 


Which can be rewritten as, 
5 


Es" xn f°), f'"(&) being the mean of £^(&), S” Ca)” En) 


Since 2mh-b-a, we have 


4 
EP = -26 — a) f" (E), where a <Ẹ <b. 


(8.14) 


b 
Algorithm: Evaluation of fy (x)dx by Simpson ’s one-third rule. 


Step 1: Define f(x) 

Step 2: Inputa, b, n (even) 

Step 3: Compute h = (b—a)/n 

Step 4: Compute S, = f (a) +f (b) 

Step 5: Set S,=0,x=a 

Step 6: Compute x 7^ x + 2h 

Step 7: Compute S, = S, f (x) 

Step 8: Check If x < b then go to Step 5 else go to next step 
Step 9: Compute x =ath 

Step 10: Compute S, = S+ f(x) 

Step 11: Compute x = x + 2h 

Step 12: Check If x > b go to next Step else go to Step 9 
Step 13: Compute /= (S+ AS, * 2S, )h/3 

Step 14: Write Z, n 
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Simpson's Three-Eighth Formula Numerical Integration and 
Numerical Differentiation 


Taking n = 3, Newton-Cotes formula can be written as, 


X 3 
[S a= n [Gr «M, St SG ea — zo YA NOTES 
Xo 0 ` È 

-as ap a E eal mua y 

OA ae A D E e A 


9 9 2 3-8 
=h TEE 


[ 9 9 3 
-h 39 i Yt d 05 Typ EX rS O73» 22227] 


Ó 3h 
J £0) & - Fy +3 +) 


(8.15) 


: PT "A dert » 
The truncation error in this formula is — mo J' EX 6623 


This formula is known as Simpson's three-eighth formula of numerical 
integration. 


As in the case of Simpson's one-third rule, we can write Simpson’s three-eighth 
rule ofnumerical integration as, 


b 
3h 
fre dx = 3 [yo | 3y, ] 3y, ] 2y, T3y, T3, *t2ye Tot 2yan-3 PIY *3y. ud + yy] 
(8.16) 
where h = (b-ay(3m); form-1,2,... 
i.e., the interval (b-a) is divided into 3m number of sub-intervals. 


The rule in Equation (8.16) can be rewritten as, 


b 
; 3h 
frw dx =- Dig Yim +3091 HY, + Vy ts tet Yau2 + Van) 203 * Y t Y, 3)l 


(8.17) 

The truncation error in Simpson's three-eighth rule is 
-an 
240 


(b-a)f" (B, x, <G<x,m 
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Numerical Integration and ^ N/egdle's Formula 
Numerical Differentiation 


In Newton-Cotes formula with n = 6 some minor modifications give the Weddle's 
formula. Newton-Cotes formula with n — 6, gives 


NOTES " " " 
pe = i| 6v, +18Ay, 27A y,  24yN y, EA y EU 


0 


; ; 41 ; 
This formula takes a very simple form if the last term ETT A’ yo is replaced by 


42 3 ; ; V 
1402 ^ = 194 ^ . Then the error in the formula will have an additional term 
1 
Yao. ^^y, . The above formula then becomes, 
T 2 3 123 ,; 3 e 
f vax = h| 6y, + 18Ay, + 27A" y, +244 y, Pas Vo a Vo 
n 3h 
f vax = 10 [Yo * 5 + y, 694 y4 +59, + y] 
(8.18) 
On replacing the differences in terms of y;'s, this formula is known as Weddle's 
formula. 
. 1 vi),t 
The error Weddle's formula is tunt yr) (8.19) 


Weddle’s rule is a composite Weddle’s formula, when the number of sub- 
intervals is amultiple of 6. One can use a Weddle’s rule of numerical integration by 
sub-dividing the interval (b —a) into 6m number of sub-intervals, m being a posi- 
tiveinteger. The Weddle's rule is, 


ME. 
f /97 15 [vy tH HOV tr ASV 2 Hy ty 6v GY, he 


! Yens ! SV ems p" ! OY a Y o2 Wend Von (8 .20) 
where b-a = 6mh 


b 
: 3h 
ie, ff) dx = T [Y + Vom *5 QUE YS + Y4 - Y tet Vens You) ^ Y3 t V4 Yg t+ VQ to 


+ Vem—a Yen 2 + 03 Yg tt Yeu a) 2Qg Yiz t Y. 9) 


. . . 1 DA Ld 
The error in Weddle's rule is given by Er (b—a)y°(§) 
(8.21) 
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Numerical Integration and 


2 
Example 1: Compute the approximate value of f x‘dx by taking four sub-inter-  Memerical Differentiation 
0 


vals and compare it with the exact value. 
NOTES 


late f(x) =x". 


x 0 05 10 15 20 
f(x) 0 0.0625 1.0 5.062 16.0 


By trapezoidal rule, we get 


2 
[^e x A04 2x (0.0625 +1.0 + 5.062) +16.0] 
0 


= 7.0672 


1 28.2 
~ 7 [12.2690 +16.0] = S Lc 


By Simpson's one-third rule, we get 


2 

0- 
[^e - EE 4x (0.0625 + 5.062) - 2x1.0 +16.0] 
0 


1 
7C H5.1354180]- 2A 


= 6.4230 


25 32 
Exact value = es 6.4 
Error in the result by trapezoidal rule = 6.4 — 7.0672 =- 0.6672 
Error in the result by Simpson’s one third rule = 6.4 — 6.4230 =— 0.0230 
Example 2: Evaluate the following integral: 


1 
fax -3x^)dx by taking n= 10 and using the following rules: 
0 


(i) Trapezoidal rule and (ii) Simpson’s one-third rule. Also compare them 
with the exact value and find the error in each case. 


Solution: We tabulate f (x) = 4x—3x?, for x = 0, 0.1, 0.2, ..., 1.0. 


x 00 01 02 03 04 05 06 07 08 09 1.0 
f(x) 0.0 0.37 0.68 0.93 1.12 1.25 1.32 1.33 1.28 1.17 1.0 
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Numerical Integration and (i) Using trapezoidal rule, we have 
Numerical Differentiation 
í 0.1 
[(4x—3x?)ax = 0+ 2(0.37 + 0.68+0.93 41.12 41.25 41.32 1.33 +1.28+1.17)+1.0] 


NOTES 3 ó3 
= vu (18.90 4- 1.0) = 0.995 


(ii) Using Simpson’s one-third rule, we have 


1 
[(4x-3x7) dx = DS (0+4(0.37+0.9341.2541.3341.17)+2(0,68+1.12+1.32 41.28) +10] 
0 


= D [4x50 2x440410] 


= tgo. =1.00 


(iii) Exact value = 1.0 


Error in the result by trapezoidal rule is 0.005 and there is no error in the result 
by Simpson's one-third rule. 


1 

Example 3: Evaluate f e^ dx, using (7) Simpson's one-third rule with 10 sub- 
0 

intervals and (ii) Trapezoidal rule. 


Solution: We tabulate values of e~* for the 11 points x = 0, 0.1, 0.2, 0.3, ...., 
1.0 as given below. 


2 
Em 


x e 
0.0 | 1.00000 

0.1 0.990050 

0.2 0.960789 
0.3 0.913931 

0.4 0.852144 
0.5 0.778801 

0.6 0.697676 
0.7 0.612626 

0.8 0.527292 
0.9 0.444854 

1.0 | 0.367879 


1.367879 3.740262 3.037901 
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Hence, by Simpson's one-third rule we have, Numerical Integration and 
Numerical Differentiation 


Je? dez et hot4 Die e fe fie ht? Oe foe fo fol 


i NOTES 
= [1.367879 + 4 x 3.740262 + 2 x 3.037901] 


[1.367879 + 14.961048 + 6.075802] 


E LAT = 0.7468243 ~ 0.746824 


Using trapezoidal rule, we get 


[fot fiot? Ath t+ 


au! [1.367879 + 6.778163] 


1 
[ e* dx= 
0 


= 0.4073021 
4 
Example 4: Compute the integral 7 = f (x? —2x° + dx, using Simpson's one-third 
0 


rule taking / = 1 and show that the computed value agrees with the exact value. 
Give reasons for this. 


Solution: The values of f(x) =x°—2x°+1 are tabulated for x = 0, 1, 2, 3, 4as 


x 0123 4 
f(x) 1 0 1 10 33 


The value ofthe integral by Simpson's one-third rule is, 


ia [Ie 4x0 2x1 e 4x10433]- 25 


4^ 43 1 
The exact value "Op Ee 


Thus, the computed value by Simpson's one-third rule is equal to the exact 
value. This is because the error in Simpson's one-third rule contains the fourth 
order derivative and so this rule gives the exact result when the integrand is a 
polynomial of degree less than or equal to three. 

0.5 


Example 5: Compute fea by (i) Trapezoidal rule and (ii) Simpson's one-third 


0.1 


rule and compare the results with the exact value, by taking / — 0.1. 
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Numerical Integration and 
Numerical Differentiation 


184 


NOTES 
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Solution: We tabulate the values of f (x) = e' for x = 0.1 to 0.5 with spacing 
h — 0.1. 


x Of 02 03 04 05 
f(x)=e* 11052 12214 1.3498 1.4918 1.6847 


The value ofthe integral by trapezoidal rule is, 


I,= OT 1052-42 (1.2214 41.3498 + 1.4918) + 1.6487] 
2 


.l 
- (2.1539 + 2x 4.0630] = 0.5439 


The value computed by Simpson’s one-third rule is, 


Iç = SP {1 1052-+4(1.2214-+1.4918) + 2x1.3498+1.6487] 


= “=12.1539-+4x2.7132+ 2.6996] = “(16.3063 = 0.5435 


Exact value = e®°— e?! = 1.6487—1.1052 = 0.5435 


The trapezoidal rule gives the value of the intergal with an error — 0.0004 but 
Simpson’s one-third rule gives the exact value. 


1 


dx 
Example 6: Compute IF FS 
0 


using (i) Trapezoidal rule (ii) Simpson's one-third 


rule taking 10 sub-intervals. Hence, find log, and compare it with the exact value 
up to six decimal places. 

1 : 
Solution: We tabulate the values of f(x) = a forx=0, 0.1, 0.2,..., 1.0 as given 


below: 


T e 


l+x 

00 y, 1.000000 

0.1 y, 0.9090909 

02 y, 0.8333333 
03 y 0.1692307 

04 y, 0.7142857 
05 y 0.6666667 

0.6 y, 0.6250000 
0.7 y, 0.5882352 

08 y, 0.5555556 
09 y, 0.5263157 


1.0 y, 0.500000 
1.500000 —3.4595391 2.7281746 


(i) Using trapezoidal rule, we have Numerical Integration and 
Numerical Differentiation 


1 
dx /—— 
1-x 
0 


AUS fi 20 *f ftf ttf 


0.1 NOTES 
= 75 05000000 +2 x (3.4595391+ 2.7281745)] 


= “1.500000 +12.3754272] = 0.6437714. 


(ii) Using Simpson’s one-third rule, we get 


1 
Os B HU KU oa aU E eH 


l+x 3 
0 


= ^ 1.500000 +4x3.4595391+ 2x 2.7281745] 


: .l 
- E +13.838156 + 5.456349] = = 20.794505 = 0.6931501 


(iii) Exact value: 


1 
j= =log,= ~ [1.500000 + 4x 3.4595391 + 2 x 2.7281745] 
+x s 


0 


= 0.6931472 


The trapezoidal rule gives the value ofthe integral having an error 0.693147 — 
0.6437714 =0.0493758, while the error in the value by Simpson's one-third rule 
is — 0. 000029. 


us 


2 

Example 7: Compute [cos 040, by (i) Simpson’s rule and (ii) Weddle's for- 
0 

mula taking six sub-intervals. 


Solution: Sub-division of [0, 2] into six sub-intervals will have 


h- 2 =15° =0-26179. For applying the integration rules we tabulate J/coso . 


Ale 


@ 0 queo 2308 — 59 — 60° 75° 90° 
Vcos0 1 0.98281 0.93061 0.84089 0.70711 0.50874 0 
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Numerical Integration and — (j) The value of the integral by Simpson’s one-third rule is given by, 
Numerical Differentiation 


I 


[1+ 4x (0.98281 + 0.84089 + 0.50874) + 2x (0.093061+ 0.070711) + 0)] 


_ 0.26179 
3 3 


NOTES 3 DISP [1+ 4x2.33244+2x1.63772] 


a eee x 13.6052 = 1.18723 


(ii) The value of the integral by Weddle’s formula is, 
PE = 0.26179 [1.05 +7.45775 + 5.04534 + 0.93061 + 0.070711] 
=3x 0.026179 [14.554411] 21.143059 ~ 1.14306 


1 
Example 8: Evaluate the integral IP [1 —0.162sin^ pd by Weddle's formula. 

0 
Solution: On dividing the interval into six sub-intervals, the length of each sub- 
interval will be = 3 s = 0-26179 =15°. For computing the integral by Weddle's 


formula, we tabulate f (ọ)= /1—0-162sin’ ọ. 


f (p) 1.0 0.99455 0.97954 0.95864 0.93728 0.92133 0.91542 


The value ofthe integral by Weddle's formula is given by, 


| .3x026179 
T 10 
— 0.078537 x19.16348 — 1.50504 


[1.0-- 5. (0.99455 + 0.92133) + 0.97954 + 6 x 0.95864 + 0.93728 + 0.91542] 


Computing an Integral to a Desired Accuracy 


For evaluating a definite integral correct to a desired accuracy, one has to make a 
suitable choice of the value of A, the length of sub-interval to be used in the for- 
mula. There are two ways of determining /, by considering the truncation error in 
the formula to be used for numerical integration or by successive evaluation of the 
integral by the technique of interval halving and comparing the results. 


Truncation Error Estimation Method 


In the truncation error estimation method, the value of / to be used is determined 
by considering the truncation error in the formula for numerical integration. Let E 
bethe error tolerance for the integral to be evaluated. Then / is chosen by using 
the condition, 


|R|<e/2 
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2 
dx 
As an illustration, consider the evaluation of Jc using Simpson’s one-third 
1 


rule accurate up to the third decimal place. We may take e 2107. 
If we wish to use Simpson’s one-third rule, then the truncation error is R, 


ht 
R2——(Q-Df*'(É; 1«&«2 
1804 FS) $ 


Then A is determined by satisfying the condition, 


ho 
— | f^ (&) |< 0:5 x10? 
iso I 


l 1 " 2x3x4 
For the given problem, f (x)=—, thus f^"C9- s - . Hence, 
X 


x 


max 
[1.2] 


f" ()|-24 


1x2 


Thus, 4*x = <0:5x10° or « 0.102 


But / has to be so chosen such so that the interval [1, 2] is divided into an 
even number of sub-intervals. Hence we may take h — 0.1 «0.102, for which n= 
10, i.e., there will be 10 sub-intervals. 


The value of the integral is, 


- L [1.5--4x3.4595 +2 x 2.7282] 


1 
= E x 2.0749 = 0.06931 which agrees with the exact value of log, . 


Interval Halving Technique 


When the estimation ofthe truncation error is cumbersome, the method of interval 
halving is used to compute an integral to the desired accuracy. 


In the interval halving technique, an integral is first computed for some moderate 


value ofA. Then, it is evaluated again for spacing L ,ie., with double the number 


of subdivisions. This requires the evaluation ofthe integrand at the new points of 
subdivision only and the previous function values with spacing / are also used. 


: ; La 
Now the difference between the integral /, and t is used to check the accuracy 


ofthe computed integral. If |, — 1,,,| € e, where € is the permissible error, then 


*dx 0.1 l 1 1 1 1 l 1 1 1 1 
—=— |{1.0+4 | —+—+—+—+4+— ]4+2] —+—+—+— |+- 
x 3 1.1 13 L5 17 19 1.2 1.4 1.6 1.8) 2 


Numerical Integration and 
Numerical Differentiation 


NOTES 


Self-Instructional 
Material 187 


Numerical Integration and [ js to be taken as the computed value of the integral to the desired accuracy. If 
Numerical Differentiation h2 


the above accuracy is not achieved, i.e., 


I, - I,,,|» £, then the computation ofthe 


NOTES integral is made again with spacing a and the accuracy condition is tested again. 


The equation of 7, ,, will require the evaluation of the integrand at the new points of 

sub-division only. 

Notes: 

1. The initial choice of / is sometimes taken as 4/g where m =2 for trapezoidal 
rule and m = 4 for Simpson’s one-third rule. 


2. The method of interval halving is widely used for computer evaluation since it 
enables a general choice of / together with a check on the computations. 


3. The truncation error A can be estimated by using Runge's principle given by, 


1 
Re 3l -1,,)| for trapezoidal rule and R ~ isl - I,)| for Simpson's one- 


third rule. 
Algorithm: Evaluation of an integral by Simpson's one-third rule with interval 
halving. 
Step 1: Set/initialize a, b, € 
[a, b are limits of integration, £ is error tolerance] 
b-a 
2 
Step 3: Compute S, =f (a) +f (b) 
Step 4: Compute S, =f (a + A) 
Step 5: Set S,= 0, 7, - 0 


Step 2: Set 4 = 


(S, - 4S, c $,)xh 
3 


Step 6: Compute /, = 


Step 7: If (/, —/,) < £, go to Step 17 else go to the next step 


Step 8: Set h=, =] 


1 2 
Step 9: Compute S, = S,+ S, 
Step 10: Set $, = 0 
Step 11: Setx -a * h 
Step 12: Compute S, = S+ f (x) 
Step 13: Setx=x+h 
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Step 14: If x < b, go to Step 12 else go to the next step Numerical Integration and 


Numerical Differentiation 
(S, +28, +4S,)xh 


Step 15: Compute /, = 3 


Step 16: Go to step 7 NOTES 


Step 17: Write Z, h, € 
Step 18: End 
Algorithm: Evaluation of an integral by trapezoidal rule with interval halving. 


Step 1: Initialize/set a, b, € [a, b are limits of integration, € is error 
tolerance] 


Step 2: Set h = b-a 


Step 3: Compute 5, - MEM 


Step 4: Compute J, = S xh 
h 
Step 5: Compute x =a + 3 
Step 6: Compute 7, = (S, + f(x))xh 


Step 7: If IZ, - In <£, go to Step 13 else go to the next step 


Step 8: Set / - 

Step 9: Setx=ath 

Step 10: Set /, - L-- h x f(x) 

Step 11: If x < b, go to Step 9 else go to next step 
Step 12: Go to Step 7 

Step 13: Write Z,, h, € 

Step 14: End 


Numerical Evaluation of Double Integrals 


We consider the evaluation of a double integral, 


I= [Léo y)dx dy (8.22) 
R 


where R is the rectangular regiona < x < b,c < y < d. The double integral can 
be transformed into a repeated integral in the following form, 


b 
fax 


d 

[ron (8.23) 
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Numerical Integration and 
Numerical Differentiation 


d 
Writing F(x)- f f(x, y)dy considered as a function of x, we have (8.24) 


Cc 


b 
NOTES r= [Foods TEN 


Now for numerical integration, we can divide the interval [a, b] into n sub- 
intervals with spacing / and then use a suitable rule of numerical integration. 


Trapezoidal Rule for Double Integral 


By trapezoidal rule, we can write the integral Equation (8.25) as, 
b 
[Fe de =F [Fy +P, 20, +F,+F,+..+F_,)] (8.26) 


b-a 
where x, =a,x =b, h= and 
0 n n 


1 
F, = FG) = | fos)». x, =a+ih (8.27) 
0 


for 1=0, 1, 2,..., n. 
Each F can be evaluated by trapezoidal rule. For this, the interval [c, d] may 
c-d 


m 


be divided into m sub-intervals each of length k = . Thus we can write, 


F, =É U Gs 9) f Yn) yD a tet f EY ma] 


(8.28) 
Y, 56, Y, =d, y, = ctik; i= 0, 1,..., m. 
This Equation (8.28) can be written in a compact form, 
k 
F, = 5 lio t Vs = 2(fa T i2 Te + faul 
(8.29) 


The relation Equations (8.26) and (8.29) together form the trapezoidal rule 
for evaluation of double integrals. 


Simpson's One-Third Rule for Double Integrals 


: : m 1 
For the evaluation of double integrals we can write Simpson's 3 rule. Thus we 


have, 


b 
17 [Feoax -ŽIR +F, 4+2(F, EF +t F, ,)+4F +F +E) (830) 
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Beg Numerical Integration and 


Where ^-2 ——. niseven and Numerical Differentiation 
n 
d 
F.=F(x) = „y)dy, x," a ih, fori 0, 1, 2, 8.31 
= FG) J f G.M, X, (8.31) — 
And, x,-aandx =b 


For evaluating /, we have to evaluate each ofthe (n + 1) integrals given in 
Equation (8.31). For evaluation of F , we can use Simpson's one-third rule by 
dividing [c, d] into m sub-intervals. F, can be written as, 

k 

F; = 3 V Gp Yo) * f Gg y.) 2f Gy) e f (4) t S Oy, at MIG yi) f Gs) 

tef Quy, 9) 


(8.32) 
Equation (8.32) can be written in a compact notation as, 
k . 1 ; 
F, E E tla *2(f, * i4 Teck in-2) * Af. fi Tec im-1)] 


Where Si =f, yj. = 0, 1, 2,...,/m. 


; 2 ffo +y” )dxdy . 
Example 9: Evaluate the following double integral where R is 
R 


the rectangular region 1 « x « 3,1 « y « 2, by Simpson's one-third rule taking 
h-k-0.5. 


Solution: We write the integral in the form of a repeated integral, 


3 [2 
I Jaje €" 
1 


1 


=0.5 


AJN 


Taking n = 4 sub-intervals along x, so that ^ = 


3 
0.5 
s f d arai er OR dC PR 
1 


2 
where F(x) = fæ + y*)dy 
1 
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Numerical Integration and 


2 
Numerical Differentiation ^ F, = F(x,) -[o y dy; x, = j4 0.5i, where t= 0, ja 2, 3, 4. 
1 


For evaluating Fs, we take k = £295 and get, 
NOTES 2 


2 
Fo = ja«»*a- per 40.5220 
1 


2 
F, = fas? y?) dy = 10.5) 41° 441,5) 40,5) 14057 +27]=92x27.50 
1 


2 
F =| +s") g= [ +1 +4 +15} 3g 
1 


0 


2 
F, [C «06 - 7 [Q.5? +1 +4 (2.5) Q9) +25)? «2 ]- sso 
1 
r 0.5 5 
F,= S [3 +P +43? «(0.55 +3? « 27] == x 68 

1 


nl =" pos 682x384 (27.50 + 51.50)] 


= 9S 480 =13.333 


Example 10: Compute f f (x? + y*)dxdy by trapezoidal rule with / = 0.5. 


R 


3 
Solution: 7, = | F@dx - = [F,FE,*2 (F 4E,HEJJ 
1 


2 
where F,- F(x) = fo y dy, x,= 1 +0.5i, i =0, 1, 2, 3, 4. 
1 


2 
Thus, F, = [a yay -2 [P - P +20? - (0.5? - P +27] 
1 


- “2 x 13.50 2 3.375 
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Numerical Integration and 


2 
K= Jta.sy ty ]dy = = [1.5 +1°+2 {(1.5)?+(1.5)7}+(1.5) +27] Numerical Differentiation 


=“ x18. 50 = 4.625 


NOTES 


2 
F, «Jp ty! My- E [2 aq 2E ce +2] 
1 


= 9? 095 5026375 
2 
F, = fi (2.57 + y] ky => [(2.5)* + 4:9 00:5Y" 4 (1.5 E (2.5 +27) 
0.5 


- EX 34.50 = 8.625 


2 
F, =f +y’ ]ldy = ni [3? +1? +243? 0:5) 1 +3? +2?] 
-22 nas. 50=11.375 
0.5 
n Ip = x[B.375 + 11.375 + 2(4.625 + 6.375 + 8.625)] 


: [14.750 +2x 19.625] 


= “[14.750 + 39.250] = 7 54 213.5 


Example 11: Evaluate the following double integral using trapezoidal rule with 


2 2 
dx 
length of sub-intervals h = k= 0.5, | [Es 
1 1 XY 
1 
Solution: Let f(x, y) = — 
x+y 
y 
2 
1.5 
1 
1 15 2 x 


Self-Instructional 
Material 193 


Numerical Integration and 
Numerical Differentiation 


By trapezoidal rule with A — 0.5, the integral 


22. 
I- ffa dy f(x,y) is computed as, 


11 


NOTES 0.5x 0.5 


I= a, D+ f, D- fü, 2)- fO, 2)+2f.5, D - fd, 1.5) 


+f(2, 1.5)+ f(.5, 2) -4f (1.5, 1.5)] 
1 1 1 1 E 2 2 2) 1 
+—+—+-—42 +—+—+—|+4x 
E 3 34 5 oW og 3 


4x12 4 
+— 
3 


1 
16 
X 


- T: 0.666661 +0.75+2x 


= + [5.492857] 
16 


= 0.343304. 


2 


2 

dxd , , i 

Example 12: Evaluate f PF by Simpson’s one-third rule. Take sub-intervals 
11 


of length h = k=0.5. 


2. 2 
Solution: The value of the integral 7 = f f f(x, y)dxdy by Simpson's one-third 
L- 
rule with A = k — 0.5 is, 


[90 a, D- £Q, DIFA D+F, 2)-* 4(f( 1.5) - f(1.5, D 
+f(2, 1.5) f(0.5, 2) -16f(1.5, 1.5)] 
cune (2424242) | 
= +—+—+4+-—+44 +—+—+4+—]+16x— 
36 |2 3 3 4 5 5 77 3 
enm 


- sc 066667 +0.75+4x 
36 3 


1 
= 36 [12.235714] = 0.339880 


Gaussian Quadrature 


We have seen that Newton-Cotes formula of numerical integration is ofthe form, 


n 


b 
[re@arx Ye se) 


i=0 


(8.33) 


where x,=a+tih, i=0, 1,2, ..., n; h= ger 
n 
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This formula uses function values at equally spaced points and gives the exact Numerical Integration and 
! : ; Numerical Differentiation 
result for f (x) being a polynomial of degree less than or equal to n. Gaussian 
quadrature formula is similar to Equation (8.33) given by, 


1 n 
f Fedu z > w.F(u,) (8.34) NOTES 
= i=l 


where ws and us called weights and abscissae, respectively are derived such 
that above Equation (8.34) gives the exact result for F(u) being a polynomial of 
degree less than or equal to 27-1. 


In Newton-Cotes Equation (8.33), the coefficients c, and the abscissae x, are 
rational numbers but the weights w, and the abscissae u, are usually irrational 
numbers. Even though Gaussian quadrature formula gives the integration of F(u) 
between the limits —1 to +1, we can use it to find the integral of f(x) from a to b 
byasimple transformation given by, 
| b-a a+b 


x= u+ 
2 2 


(8.35) 


Evidently, then limits for u become —1 to 1 corresponding to x = a to b and 
writing, 
a+b 
2 


s= ns ]- Ft) 


b 1 
We have, f wax 22 a [roa 


(8.36) 
It can be shown that the u, are the zeros of the Legendre polynomial P (u) of 
degree n. These roots are real but irrational and the weights are also irrational. 
Given below is a simple formulation ofthe relevant equations to determine u, 
and w. Let F(u) be a polynomial of the form, 


2n-1 


F(u)= Yau" (8.37) 


k=0 


Then, we can write 


1 l[2n-1 
f F(u)du = f Sau a (8.38) 
-1 


-1L k=0 


1 
Or, [riodu - 22, 2a, +a, LÀ (8.39) 


a 
i In-2 2n-2 
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NOTES 


Self-Instructional 
196 Material 


Equation (8.34) gives, 
1 n 2n-1 
f Pena = Sn Seo 
k=0 


8.40 
= Y wilag +a; + ayu? ay, ud") Á ) 
i=l 
The Equations (8.39) and (8.40) are assumed to be identical for all polynomials 
of degree less than or equal to 2n—1 and hence equating the coefficients ofa, on 


either side we obtain the following 27 equations for the 2n unknowns w, w,,...,W,, 
and u,, U,,...,l.. 

2 RE Dad 
Y» -2 XL wl E wu;  -0 (8.41) 


i=l 


The solution of Equation (8.41) 1s quite complicated. However, use of Legendre 
polynominals makes the labour unnecessary. It can be shown that the abscissae u, 
are the zeros of the Legendre polynomial P (x) of degree n. The weights w, can 
then be easily determined by solving the first n equations of Equations (8.41). As 
an illustration, we take n —2. The four equations for u, u,, w, and w, are, 

w tw, =2 
wu, tw,u, =0 


2 2 
Wit "E Wu, =— 


3 


3 3 
wu, tW, 0 


Eliminating w,, w,, we get 
w uz u> 
W» Un uj 
Or, usw, -uquj = 0 or wu, (u? — u5)=0 
Since, u; zu, #0, we have u, =—u,. 


; ; ; 2 
Also, w, =w, = 1. The third equation gives, 2u; = 2 —u- 


Hence, two point Gauss-Legendre quadrature formula is, 
| Fedu = (+) + r- 
2 v3 45 


The Table 8.1 gives the abscissae and weights ofthe Gauss-Legendre quadra- 
ture for values of from 2 to 6. 


Table 8.1 Values of Weights and Abscissae for Gauss-Legendre Quadrature Numerical Integration and 
Numerical Differentiation 


n Weights Abscissae 
1.0 + 0.57735027 
3 0.88888889 0.0 NOTES 
0.55555556 + 0.77459667 
4 0.65214515 + 0.33998104 
0.34785485 +0.86113631 
5 0.56888889 0.0 
0.47862867 + 0.5384693 1 
0.23692689 + 0.90617985 
6 0.46791393 + 0.23861919 
0.36076157 + 0.66120939 
0.17132449 + 0.93246951 


It is seen that the abscissae are symmetrical with respect to the origin and the 
weights are equal for equidistant points. 


2 
Example 13: Compute f (1+ x)dx, by Gauss two point quadrature formula. 
0 


2 
Solution: Substituting x = u + 1, the given integral f (l+x)dx reduces to 
0 


1 

I= [ew Dau, Using a two point Gauss quadrature formula, we have / = 
si 

(0.57735027+2) + (— 0.57735027+2) = 4.0. 
As expected, the result is equal to the exact value of the integral. 

Example 14: Show that Gauss two-point quadrature formula for evaluating 


b b N 
f f (x)dx can be written in the composite form as [/ (x)dx = hy) [FG )+ £5] 


i=0 
a 


where r,=x,+ hp, s,=x,+ (1—p)h, p -16-45. 


Solution: We subdivide the interval [a, b] into N sub-intervals, each of length A, 
b-a 


given by } = 


Yi 


Consider the integral /, over the interval (x, x,,,), i.e., J, = f f (x)dx . 


We transform the integral /. by putting x = Lu + [s + +) so that x — x, gives 


1 
u=—landx=x.,, gives u = 1. Thus, 7, Ape 
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Numerical Integration and The Gauss two point quadrature gives, 


Numerical Differentiation 
h h 1 h h h 
H-2— f > +x tlt tX + 
2 E 45 J | 243 4) 


: AU GG] 


NOTES 


1 
where r,=x,+ ph, s,=x,+(1—p)h, p- 8-43) 


b N-1 h N-1 
Hence, JfGMx- 11, => DU) +S) 
É i=0 i=0 


Note: Instead of considering Gauss integration formula for more and more num- 
ber of points for better accuracy, one can use a two point composite formula for 
larger number of sub-intervals. 


Example 15: Evaluate the following integral by Gauss three point quadrature 
formula: 


Solution: We first transform the interval [0, 1] to the interval (1, 1) by substitut- 
1 1 
dx dt 
ing t= 2x — 1, so that | — = | —. 
Now by Gauss three point quadrature we have, 


, 1 
I= ; [SF (0) + 5F (3+ 0.77459667) + SF (3.77459667)] with F(1) =—— 


"10.693122 


1 
dx 
The exact value of Fee mm =In2 = 0.693147 
0 


Error = 0.000025 


Romberg's Procedure 


This procedure is used to find a better estimate of an integral using the evaluation 
of the integral for two values of the width of the sub-intervals. 


b 
LetJ, and J, be the values of an integral 7 = [fe dx, with two different num- 


ber of sub-intervals of width A, and A, respectively using the trapezoidal rule. Let 
E, and E, be the corresponding truncation errors. Since the errors in trapezoidal 
rule is of order of h,, we can write, 
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I =1,+ Kh; and I 2 I, + Kh}, where K is approximately same. 


L+K =1,+Kh; 


ded 
h -h 
I-I IN LEA 
1 2 2 12 21 
Thus, / * /, t5 —;.h 2—5—3 
h? —h; hy —h; 
h, 


In Romberg procedure, we take h, = E and we then have, 


Or, I-L- e 
3 


This is known as Romberg's formula for trapezoidal integration. 


The use of Romberg procedure gives a better estimate of the integral without 
any more function evaluation. Further, the evaluation of 7, with h/2 uses the func- 
tion values required in evaluation of . 


1 
dx 
Example 16: Evaluate / = f 1452 by trapezoidal rule with h, =0.5andh, = 0.25 
0 
and then use Romberg procedure for a better estimate of 7. Compare the result 


with exact value. 


1 : 
Solution: We tabulate the value of x and y= 12 with h= 0.25. 


x 0 025 O5 075 1.0 
y 1 0.9412 0.80 0.64 0.5 


Thus using trapezoidal rule, with A, — 0.5, we have 
0.5 
1, => x(1+0.5+2x0.8) -0516 


Similarly, with h, = 0.25, 


| 0.25 


L [1+0.5+2 (0.8 - 0.9412 + 0.64)] 


= 0.5218 


Numerical Integration and 
Numerical Differentiation 


NOTES 


Self-Instructional 
Material 


199 


Numerical Integration and The evaluation of J, uses the function values for evaluation of Z. 
Numerical Differentiation 


By Romberg formula, 


1 
Ixl +- (L-I) 
NOTES ub LE 


- 0.52184 (05218-0519). 


=0.5218 0.0019 
= 0.5237 


The exact integral = tan"! x, = " = 0:5237. 


Thus we can take the result correct to four places of decimals. 


2 
Example 17: Evaluate / = f A by trapezoidal rule with two and four sub-inter- 
X 
1 
vals and then use Romberg procedure to get a better estimate of J. 


ls ; 1 
Solution: We form a table of value of y = ~ with spacing ^ = 4709» 


1 125 L5 1.75 2.0 
y 1 08 0.6667 0.5714 0.5 


i= al + 0.5 + 2 x 0.6667] = 0.7084 


L= E [1+0.5+2 (0.84- 0.6667 + 0.5714)] = 0.6970 
By Romberg proecedure, 
I=I,+ Dou. 0.6970 —(-0.0114) 


= 0.6970 — 0.0038 = 0.6932 


1 
Example 18: Compute the value of f = (i) by Gauss two point and (ii) by 
X 
0 
Gauss three point formulas. 
Solution: We first transform the integral by substituting x = — + jo +a) 


rie. ace: cd lp 2 

eta! 55] 5.55 

I+x 24 1 1, 223«t 
2 
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Numerical Integration and 
Numerical Differentiation 


1 
F . 1 
(i) By Gauss two point quadrature | F(t)dt = ] + A IE get, 
owe j E 


hd NOTES 
Í dt = " — 0.6923 
E foe ce 

V3 3 


(ii) By Gauss three point quadrature, 


1 
— d= E 0.888888 + 


0.55555556 
“3+t 


3 + 0.77459667 
= 0.443478 
2 


Example 19: Compute f e*dx by Gauss three point quadrature. 
1 


Solution: We first transform the integral by substituting x = 2 2 “t+ ; (b+a)= ; t+ 


3 1 1 
1 =, =, —- 
= —e? | 0.88888889x e? 4-0.55555556x« e? x0.77459667 +e? Ll 


= 4.67077 


Check Your Progress 


. How will you evaluate a definite integral? 

. Write the trapezoidal formula for numerical integration. 

. What is Simpson’s one-third formula of numerical integration? 
. Define Simpson’s three-eighth rule of numerical integration. 

. State Weddle's rule. 

. Why is Romberg's procedure used? 


QN nn BW NY — 


83 NUMERICAL DIFFERENTIATION 


Numerical differentiation is the process of computing the derivatives ofa function 
f(x) when the function is not explicitly known, but the values ofthe function are 
known only at a given set of arguments x = x,, x,, X,,.... X, For finding the 
derivatives, we use a suitable interpolating polynomial and then its derivatives are 
used as the formulae for the derivatives ofthe function. Thus, for computing the 
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me ee ee derivatives at a point near the beginning of an equally spaced table, Newton’s 
i forward difference interpolation formula is used, whereas Newton's backward 
difference interpolation formula is used for computing the derivatives at a point 
near the end ofthe table. Again, for computing the derivatives at a point near the 
NOTES middle ofthe table, the derivatives ofthe central difference interpolation formula is 
used. If, however, the arguments ofthe table are unequally spaced, the derivatives 
ofthe Lagrange's interpolating polynomial are used for computing the derivatives 
ofthe function. 


Differentiation Using Newton's Forward Difference 
Interpolation Formula 


Let the values of an unknown function y — f(x) be known for a set of equally 
spaced values x,, x,, ..., x, of x, where x, — x, +r, Newton's forward differ- 
ence interpolation formula is, 


Q(u)- yo tu A y, 


0 


E -D Ay, + u(u I —2) Mees u(u—1)(u—2)...(u-—n +1) A"y, 


n ! 


Xo 


X 
where u = 


at suot wa 
The derivative A can be evaluated as, 


d 
dy d _ dọ du dq 
A uq a des 
2: 3 2 
Thus, y'(x)7 ; |o prec aet 2 Ta D Se 
(8.42) 
Similarly, y”(x)= Sor) 

" 1 6^ —18u +11 

Or, y O= An tapan EEEa, e (8.43) 


For a value of x near the beginning ofa table, u = (x —x )/ is computed first 
and then Equation (8.42) and (8.43) can be used to compute f'(x) and f"(x). At 


the tabulated point x,, the value ofu is zero and the formulae for the derivatives 
are given by, 


j 1 l2 Lu l 4 ls 
A A yg t —AN A yg t—-A Ns 
y (xo) H Yo A Yo t y A yo 7A Yo t: A Yo (8.44) 


> 1 11 5 
y"(%0) =F |» A yo S A Yo Se (8.45) 
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Differentiation Using Newton's Backward Difference Interpolation Formula 


For an equally spaced table of a function, Newton's backward difference 
interpolation formula is, 
v(v +1) 


aA V’y, + 


Ov)=y, +v Vy, + 


v(v+D(v+2) 5 v(v + D(v 4 2)(v +3) Ga 
31 Vey, + V'y, +... 


4 ! 


ít D (vt n-D) 


V"y, 
n! 


PM 
where v= 


" d d’ i : - 

The derivatives E. and a obtained by differentiating the above formula 
X 
are given by, 
2 3 2 
dy | v Ed NE: ROV RÀ UE nac" +9v ANR d 
dx h 2 6 12 
(8.46) 

dye ee ale, 3. 6v +18v411 4 
———— VMV^y, t DV y, +———_ Vj, +» 
de 5 EPIS 12 7h (8.47) 


d d? 
For a given x near the end of the table, the values of = and Ex are com- 
X 


puted by first computing v = (x — x,)/h and using the above formulae. At the 
tabulated point x , the derivatives are given by, 


, 1 I2 ls l 54 
=—|Vy,+—V +—V +—V +... 
y(n) H Yatzy TY gigs VoM 
(8.48) 
P l2 3 ll_4 25 
=—|V +V°y, +—V HEN Yg +... 
V&n) n | XV CE S V REV 
(8.49) 


Example 20: Compute the values of /'(2.1), f"(2.1), /'(2.0) and /"(2.0) when f 
(x) is not known explicitly, but the following table of values is given: 


x Ax) 
2.0 0.69315 
2.2 0.78846 
24 0.87547 


Numerical Integration and 
Numerical Differentiation 


NOTES 
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Numerical Integration and Solution: Since the points are equally spaced, we form the finite difference table. 
Numerical Differentiation 


x Sf AGS ALG) 
2.0 0.69315 
NOTES 9531 
2.2 0.78846 —83 
8701 
2.4 0.87547 


For computing the derivatives at x = 2.1, we have 


7 1 2u-1 FARNE 
[097,195 * 7 Afh] and f Q) 7 45A fi 
QX-* 21-20 05 
h 0.2 
2x0.5-1 


f'Q.)- aa | 0.09531 + A? 4| = 0.4765 


1 


Je. (0.2)! 


x(—0.00083) = —0.21 


The value of /"(2.0) is given by, 


[ MES p 2 
reo M Ta 4 


= 5 0.0958 1+ E x 0.00083] 
0.2 2 


_ 0.09572 _ 0.4786 


TENIS 
f 0.0) = Oop 


= -0.21 


Example 21: For the function f(x) whose values are given in the table below 
compute values of /'(1), £"(1), /'(5.0), "(5.0). 


x (—0.0083) 


x 1 2 3 4 5 6 
f(x) 7.4036 7.7815 8.1291 8.4510 8.7506 9.0309 
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Solution: Since f(x) is known at equally spaced points, we form the finite differ- ee ; ki icd die 
ence table to be used in the differentiation formulae based on Newton's interpo- Ce ee 
lating polynomial. 


x fG) MG) MfG) SFR MfG) NfQ) NOTES 
1 7.4036 
0.3779 
2 7.7815 —303 
0.3476 46 
3 8.1291 —257 —]2 
0.3219 34 8 
4 8.4510 — 223 —4 
0.2996 30 
5 8.7506 —193 
0.2803 
6 9.0309 


To calculate /'(1) and /"(1), weusethe derivative formulae based on Newton's 
forward difference interpolation at the tabulated point given by, 


"yyl lar lpr laap las 
f'G)- 1| M - 3 f 38 f LA EAN 
CENE D PEE REO 

foo gs A hM HIA TIR 


apa H 0.3779 -2«(-00308) ex 0.0046- x (-0.0012) +-£0,0008 


= 0.39507 


ra= [00303 — 0.0046 + = x (0.0012) : 0.008 
= 0.0367 


Similarly, for evaluating /'(5.0) and f"(5.0), we use the following formulae 


1 1 1 1 1 
SEH MAAAR ee 
$0 ys Lv, £V, ev, EM 
f'5)- 0.2996 0.0223) +-$ 0.0034 1 (-0.0012) 
= 0.2893 
f"(5) = [0.02234 0.0034-+— 0.0012] 
= —0.0178 
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Numerical Inregranón:and Example 22: Compute the values of y'(0), y"(0.0), y'(0.02) and y"(0.02) for the 


Numerical Differentiation 


function y — f(x) given by the following tabular values: 


x 00 005 010 015 020 025 
NOTES y 0.00000 0.10017 0.20134 0.30452 0.41075 0.52110 


Solution: Since the values of x for which the derivatives are to be computed lie 
near the beginning ofthe equally spaced table, we use the differentiation formulae 
based on Newton's forward difference interpolation formula. We first form the 
finite difference table. 


x y Ay Wy Ny Ay 
0.0 0.00000 


0.10017 
0.05 0.10017 100 
0.10117 101 
0.10 0.20134 201 3 
0.10318 104 
0.15 0.30452 305 3 
0.10623 107 
0.20 0.41075 412 
0.11035 
0.25 0.52110 


For evaluating y'(0,0), we use the formula 


1 1 l 1 
y (xo) = i ax -4 t8 EQUI 


y'(0.0) = sas 0.10017 a i. 0.00100 + Li 0.00101 ae 0.00003] 
0.05 2 3 4 


= 2.00000 
For evaluating »'(0,0), we use the formula 
y'(x,) = s» m Ayo + Ha'n) 
"E 
~ (0.05 
= 0.007 


[0.00100 — 0.00101 eu 0.00003) 


For evaluating y'(0.02) and y" (0.02), we use the following formulae, with 


|.0.02-0.00 _ 
0.05 


0.4 
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Numerical Differentiation 


2 3 2. 
= M NEZ Erat, E IE ae 


6(u —1) 3 6: —18u+11 4 
Ay, + xA 
6 Yo 12 Yo 


1 Numerical Integration and 
»0.02)-- |o + | 


y'(0.02) = Fin + 
NOTES 


2x04-1 3x (0.4) —6x0.4 2 


y'(0.02) - 0.10017 + x 0.00100 + x 0.00101 
0.05 2 6 


3 2 E 
2x04 - 9x04 +11x04-3 giois 
12 
= 4.00028 
002) == =| 0.00100 -0.00101%( s] 
(0.05) 12 
= 0.800 


Example 23: Compute /'(6.0) and /"(6.3) by numerical differentiation formulae 
for the function f(x) given in the following table. 


x 6.0 6.1 6.2 6.3 6.4 
f(x) -0.1750 -0.1998 -0.2223 -0.2422 -0.2596 


Solution: We first form the finite difference table, 
x fe) AQ) Nfe) Af) 


6.0 —0.1750 
-248 
6.1 -0.1998 23 
-225 3 
62 -0.2223 26 
-199 -1 
6.3 -0.2422 25 
-174 
6.4 -0.2596 


For evaluating f'(6.0) , we use the formula derived by differentiating Newton's 
forward difference interpolation formula. 


iio Al agg Laie dua 
FODH de - S f 438° | 


f'(6.0) = a; -0.0248 E 0.0003 
0.1 2 3 
= 10[-0.0248 — 0.00115 + 0.0001] 
= 0.2585 
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Numerical Integration and 
Numerical Differentiation 


For evaluating /"(6.3), we use the formula obtained by differentiating Newton's 
backward difference interpolation formula. It is given by, 


1 
n" n Vv? Jk Vo 
MESE f'G,) e TAWA hl 
1 
(0.1) 
Example 24: Compute the values of y'(1.00) and y"(1.00) using suitable numeri- 


cal differentiation formulae on the following table of values of x and y: 


f"(6.3) = 


+ [0.0026 + 0.0003] = 0.29 


x 1.00 1.05 1.10 1.15 1.20 
y 1.0000 1.02470 1.04881 1.07238 1.09544 


Solution: For computing the derivatives, we use the formulae derived on differ- 
entiating Newton’s forward difference interpolation formula, given by 


i 1 I. I4 l4 
Xo) = A A yg +—A A yg +... 
f(x) “| Yo 2 Yo 3 Yo 4 Yo 


i l2 3 ll 4 
Xg)7 A A yo +—A yo +... 
f (xo) 4 Yo Yo 12 Yo 


Now, we form the finite difference table. 


x y Ay Ny N y At y 
1.00 1.00000 
2470 
1.05 1.02470 -59 
2411 5 
1.10 1.04881 -54 -2 
2357 3 
1.15 1.07238 -51 
2306 
1.20 1.09544 


Thus with x, = 1.00, we have 


y'(1.00) = L| 0.02470 10.000594 1x 0.00005 +} x 0.00002 
0.05 2 3 4 
= 0.502 
j 1 11 
y"(1.00) = — | -0.00059 — 0.00005 — — x 0.00002 
(0.05) 12 


= —0.26 
Example 25: Using the following table of values, find a polynomial representation 
of f'(x)andthen compute f'(0.5). 


x 01 2 3 


Self-Instructional f(x 1 3 15 40 
208 . Material 


Solution: Since the values of x are equally spaced we use Newton's forward 
difference interpolating polynomial for finding f'(x) and /'(0.5). We first form the 
finite difference table as given below: 


x fo Arg) Af) W'fü) 


0 | 

2 
1 3 10 

12 3 
2 15 13 

25 
3 40 

X — Xo 


= x. Thus the Newton's forward difference 


Taking x, 20, we have u = 


interpolation gives, 
fonus dn M f, " u(u De -2) 8 f, 
i.e., f(x) S14 2x4 IT un ie) 
Or, fG)- lei +x 
f'G)-3- Ie 
and, f 0.5) 23-1305 2 (0.5) =-3.12 


Example 26: The population ofa city is given in the following table. Find the rate 
of growth in population in the year 2001 and in 1995. 


Year x 1961 1971 1981 1991 2001 
Population y 40.62 60.80 79.95 103.56 132.65 


: . . d 
Solution: Since the rate of growth ofthe population is x we have to compute 


£ atx=2001 and at x = 1995. For this we consider the formula for the deriva- 


tive on approximating y by the Newton's backward difference interpolation given 
by, 
Qutl_» 3u? tél, | 2u? +9u? +1lu+3 4 


dy 1 
=—| Vy, + V +—— V RAT 
nc Yn 2 Yn 6 Yn 2 Yn 


Numerical Integration and 
Numerical Differentiation 


NOTES 
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NOTES 
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X — X 
Where u = 7 : 


For this we construct the finite difference table as given below: 


x y Ay Ny N y A* y 
1961 40.62 
20.18 
1971 60.80 —1.03 
19.15 5.49 
1981 79.95 4.46 —4.47 
23.61 1.02 
1991 103.56 5.48 
29.09 
2001 132.65 


For x = 2001, «="=“*=0 


(2) = EE E eqs (47) | 
2001 2 3 4 


dx Jaw 10 
=3.105 
1995—1991 
For x = 1995, Km =0.4 
(2) = js ELS dada Met Eti 549] 
dx), 10 2 6 
-321 


8.4 OPTIMUM CHOICE OF STEP LENGTH 


In numerical analysis, numerical differentiation describes algorithms for estimating 
the derivative of a mathematical function or function subroutine using values ofthe 
function and perhaps other knowledge about the function. The simplest method is 
to use finite difference approximations. 


An important consideration in practice when the function is calculated 
using floating-point arithmetic is the choice of step size, A. If chosen too small, the 
subtraction will yield a large rounding error. In fact, all the finite-difference formulae 
are ill-conditioned and due to cancellation will produce a value of zero if / is small 
enough. Iftoo large, the calculation ofthe slope ofthe secant line will be more 
accurately calculated, but the estimate of the slope of the tangent by using the 
secant could be worse. 


For the numerical derivative formula evaluated at x and x +h,achoice Numerical Integration and 
Numerical Differentiation 


for h that is small without producing a large rounding error is /ex (though 

not when x = 0), where the machine epsilon e is typically of the order of 

2.2 x 1075. A formula for / that balances the rounding error against the secant NOTES 
error for optimum accuracy is, 


Though not when f"(x) ^ 0, and to employ it will require knowledge of the 
function. 


For single precision the problems are exacerbated because, although x may 
bea representable floating-point number, x + / almost certainly will not be. This 
means that x + / will be changed (by rounding or truncation) to a nearby machine- 
representable number, with the consequence that (x + A) — x will not equal h; 
the two function evaluations will not be exactly / apart. Consequently, since most 
decimal fractions are recurring sequences in binary (just as 1/3 1s in decimal) a 
seemingly round step, such as A — 0.1 will not be a round number in binary; it is 
0.000110011001100... 


Check Your Progress 


7. Definethe process of numerical differentiation. 


8. Write Newton's forward difference interpolation formula. 


9. Write Newton's backward difference interpolation formula. 


8.5 EXTRAPOLATION METHOD 


The interpolating polynomials are usually used for finding values of the tabulated 
function y — f(x) for a value of x within the table. But, they can also be used in 
some cases for finding values of f(x) for values of x near to the end points x, or x, 
outside the interval [x,, x, ]. This process of finding values of f(x) at points beyond 
the interval is termed as extrapolation. We can use Newton’s forward difference 
interpolation for points near the beginning value x,. Similarly, for points near the 
end value x , we use Newton’s backward difference interpolation formula. 


Example 27: With the help of appropriate interpolation formula, find from the 
following data the weight of a baby at the age of one year and of ten years: 


Age-x 3. 1e p 9 
Weight = y (kg) 5 8 12 17 
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Numerical Integration and. Solution: Since the values of x are equidistant, we form the finite difference table 
Numerical Differentiation ; f à : E $ 
for using Newton ’s forward difference interpolation formula to compute weight of 
the baby at the age of required years. 


NOTES x y Ay Ny 

3.35 
3 

5. 8 1 
4 

7 12 1 
5 

9 17 

Taking x = 2, u= i =-0.5. 


Newton’s forward difference interpolation gives, 
yatx=1, y(1) -5-05x3 4 SICS 


=5-1.5+0.38 = 3.88 2 3.9 kg. 


Similarly, for computing weight of the baby at the age of ten years, we use 
Newton's backward difference interpolation given by, 
x-x, 10-9 


y 2 0.5 
h 2 


0.5x1.5 1 


x 


y at x z10, y(10) 217 - 0.5x 54 


=174+2.5+0.38=19.88 


8.6 ANSWERS TO CHECK YOUR PROGRESS 
QUESTIONS 


1. The evaluation ofa definite integral cannot be carried out when the integrand 
f(x) is not integrable, as well as when the function is not explicitly known 
but only the function values are known at a finite number of values of x. 
There are two types of numerical methods for evaluating a definite integral 
based on the following formula: 


b 
[roo ax 


2. The formulais, | /G94x- 5, * /1. 
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Numerical Integration and 


3. The formula is, IM = Lf +4f +f). Numerical Differentiation 
f 3h 

4. Simpson's three-eighth rule of numerical integration is, f f(x)dx= 23 Ly NOTES 

F 3y, + 3y, + 2y, + Sy, + Sy, F2y t E 2yu, ES T 3S Y 

M h e r e 

h= (b-a) (3m); for m= 1,2, ... 

b 
3h 

5. The Weddle's rule is, [roa Ly, + 5y, * y, + Oy, * y, + Sy, + 2y, 4 


3y, F yy + Oy, E yy T Sy, Foe + Wem T gus Yos a OY T Vem 
4 Syg, Y, Where b — a = 6mh. 

6. This procedure is used to find a better estimate of an integral using the 
evaluation ofthe integral for two values ofthe width ofthe sub-intervals. 


7. Numerical differentiation is the process of computing the derivatives ofa 
function f(x) when the function is not explicitly known, but the values ofthe 
function are known for a given set of arguments x = x,, x,, x, ..., X, To 
find the derivatives, we use a suitable interpolating polynomial and then its 
derivatives are used as the formulae for the derivatives ofthe function. 


8. Newton's forward difference interpolation formula is, 


u(u —1 u(u -Y(u—-2 u(u -D(u —2)..(u-n-41) ,, 
KU pud pee) ENED) oe, cues) GE 5, 


ni} 


where u =~— 


9. Newton’s backward difference interpolation formula is, 


v(v «1 v(v - D(v +2 v(v + D(v + 2)(v +3 
Q(v)- y,*v Vy,4 ( Dy^y, ( x lyy 4 (v * Dv * 2 PM 


2 4! 
(v D. n-1) 
i n! 


V"y, 


Where v= Y 
h 


8.7 SUMMARY 


e Numerical differentiation is the process of computing the derivatives ofa 
function f(x) when the function is not explicitly known, but the values ofthe 
function are known only ata given set of arguments x —x,, x,, x,, ..., X, 


e For computing the derivatives at a point near the beginning of an equally 
spaced table, Newton's forward difference interpolation formula is used, 
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Numerical Integration and whereas Newton's backward difference interpolation formula is used for 
Numerical Differentiation . A . : 
computing the derivatives at a point near the end ofthe table. 


e Numerical methods can be applied to determine the value of the integral 
when the integrand is not integrable as well as when the function is not 


NOTES explicitly known but only the function values are known. 


e The two types of numerical methods for evaluating a definite integral are 
Newton-Cotes quadrature and Gaussian quadrature. 


Taking n = 2 in the Newton-Cotes formula, we get Simpson’s one-third 
formula of numerical integration while taking n = 3, we get Simpson's three- 
eighth formula of numerical integration. 


In Newton-Cotes formula with n = 6 some minor modifications give the 
Weddle’s formula. 


e For evaluating a definite integral correct to a desired accuracy, one has to 
make a suitable choice of the value of A, the length of sub-interval to be 
used in the formula. 


There are two ways of determining A, by considering the truncation error in 
the formula to be used for numerical integration or by successive evaluation 
of the integral by the technique of interval halving and comparing the results. 


In the truncation error estimation method, the value of h to be used is 
determined by considering the truncation error in the formula for numerical 
integration. 

e When the estimation of the truncation error is cumbersome, the method of 
interval halving is used to compute an integral to the desired accuracy. 


e Numerical evaluation of double integrals is done by applying trapezoidal 
rule and Simpson’s one-third rule. 


This procedure is used to find a better estimate of an integral using the 
evaluation of the integral for two values of the width of the sub-intervals. 


e For finding the derivatives, we use a suitable interpolating polynomial and 
then its derivatives are used as the formulae for the derivatives of the function. 


e For computing the derivatives at a point near the beginning of an equally 
spaced table, Newton’s forward difference interpolation formula is used, 
whereas Newton’s backward difference interpolation formula is used for 
computing the derivatives at a point near the end of the table. 


Let the values of an unknown function y — f(x) be known for a set of equally 
spaced values x,, x,, ..., x, of x, where x =x, +r, Newton’s forward 
difference interpolation formula is, 


u(u-1 u(u—1)(u—2) u(u—l)(u—2)..(u—n+l) ,, 
Q(u)- tu A y+ B Diary, + E A yy tet ay A'y, 


X — Xo 
where u = a8 
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e At the tabulated point x,, the value of u is zero and the formulae for the Numerical Integration and 
MAE , Numerical Differentiation 
derivatives are given by, 


1 1 1 1 1 
(00) =F] avo Zann Ayo- A yg + yc. 


3 4 5 NOTES 
" 1 2 3 11 4 5 5 
Xo) =—| A yo -A yo +—A yg - — N yo +... 
y" (xo) 4 Yo Yo 12 Yo 6 Yo | 
CNN d’y 
e For a given x near the end of the table, the values of 2 and uds 
X X 


computed by first computing v = (x — x, /h and using the above formulae. 
At the tabulated point x , the derivatives are given by, 


; 1 p PE l c4 
X,)9 — Vy, * — V y, 2 V yq -—V ya t. 
y Gn) l WEN Un a 


" 1 2 3 11 4 5 5 
X,)9 —| Voy, tV y, t— V yg t—V yq te 
y'(x,) Al VEF tM data Vode 
e For computing the derivatives at a point near the middle of the table, the 


derivatives of the central difference interpolation formula is used. 


Ifthe arguments of the table are unequally spaced, then the derivatives of 
the Lagrange’s interpolating polynomial are used for computing the derivatives 
of the function. 


KEY WORDS 


e Newton-Cotes quadrature: This is based on integrating polynomial 
interpolation formulae and requires a table of values of the integrand at 
equally spaced values of the independent variable x. 


Trapezoidal formula: The trapezoidal formula of numerical integration is 
defined using the definite integral of the function f(x) between the limits x, 
to x,, as itis approximated by the area of the trapezoidal region bounded 
by the chord joining the points (x,, f;) and (x,, fi), the x-axis and the 
ordinates at x = x, and at x = x,. 

e Romberg's procedure: This procedure is used to find a better estimate of 
an integral using the evaluation ofthe integral for two values ofthe width of 
the sub-intervals. 


Weddle’s rule: It is a composite Weddle's formula and is used when the 
number of sub-intervals is multiple of 6. 
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Numerical Integration and e Numerical differentiation: It is the process of computing the derivatives 
Numerical Differentiation ‘ SCC: Ei 

ofa function f(x) when the function is not explicitly known, but the values of 

the function are known for a given set of arguments x —x,, x,, Xs ..., X,. 

e Newton's forward difference interpolation formula: The Newton’s 

forward difference interpolation formula is used for computing the derivatives 


at a point near the beginning of an equally spaced table. 


NOTES 


e Newton’s backward difference interpolation formula: Newton’s 
backward difference interpolation formula is used for computing the 
derivatives at a point near the end of the table. 


e Central difference interpolation formula: For computing the derivatives 
at a point near the middle of the table, the derivatives of the central difference 
interpolation formula is used. 


8.9 SELF ASSESSMENT QUESTIONS AND 
EXERCISES 


Short-Answer Questions 


1. State Newton-Cotes formula. 


2. State the trapezoidal rule. 


W 


. What is the difference between Simpson's one-third formula and one-third 
rule? 


. What is the error in Weddle’s rule? 

. Give the truncation error in Simpson’s one-third rule. 

. Whereis interval halving technique used? 

. Name the methods used for numerical evaluation of double integrals. 


. State the Gauss quadrature formula. 


So ON DN A 


. State an application of Romberg’s procedure. 
10. Define the term numerical differentiation. 


11. How the derivative 2 can be evaluated? 
X 


12. Give the formulae for the derivatives at the tabulated point x0 where the 
value ofu is zero. 


13. Give the differentiation formula for Newton's backward difference 
interpolation. 


14. Givethe Newton's backward difference interpolation formula for an equally 
spaced table of a function. 
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Long-Answer Questions Numerical Integration and 
Numerical Differentiation 


1. Use suitable formulae to compute y'(1.4) and y"(1.4) for the function y 7f 
(x), given by the following tabular values. 


x l4 18 22 26 30 NOTES 


y 0.9854 0.9738 0.8085 0.5155 0.1411 


2. Compute - and € for x = 1 where the function y = f (x) is given by the 
following table: 


x12 3. 4 5 6 
y 18 27 64 125 216 


20 
3. Compute f f (x) dx by Simpson's one-third rule, where: 
0 


x 0 5 10 I5 20 
f(x) L0 L6 38 82 154 


4 
4. Compute f x? dxby Simpson’s one-third formula and comment on the 
0 


result: 
x 02 4 
x 0 8 64 


2 
5. Compute f x? dx by Simpson's one-third formula and comment on the result: 
0 
2 
6. Compute f e* dx by Simpson’s one-third formula and compare with the 
0 
exact value, where e° = 1, e! = 2.72, — 7.39. 


dx 


14x? 


1 
7. Compute an approximate value of z, by integrating f , by Simpson’s 
0 


one-third formula. 


8. A rodis rotating in a plane about one of its ends. The following table gives 
the angle 0 (in radians) through which the rod has turned for different values 


; Te .. ad l 
of time ¢ seconds. Find its angular velocity ae and angular acceleration 


d^0 


d at t= 1.0. 
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Numerical Integration and 
Numerical Differentiation tsecs 0.0 0.2 04 06 08 1.0 
O radius 0.0 0.12 0.48 1.10 2.00 3.20 


Z atx ^ 1 and at x = 3 for the function y= f(x), whose 


2 
X 


; dy d 
NOTES 9. Find 2 and 


values are given in the following table: 


x 1 2 3 4 5 6 
y 2.7183 3.3210 4.0552 4.9530 6.0496 7.3891 


10. Find - and - at x = 0.96 and at x = 1.04 for the function y = f(x) 


giveninthe following table: 


x 0.96 0.98 1.0 1.02 1.04 
y 0.7825 0.7739 0.7651 0.7563 0.7473 


11. Compute fo * Ddx, by trapezoidal rule by taking four sub-intervals and 


comment on the result by comparing it with the exact value. 


12. Compute f Gc + 2)dx, by Simpson’s one-third rule by taking four sub-intervals 


and find the error in the result. 


13. Evaluate [cos x dx, correct to three significant figures taking five equal sub- 


intervals. 


14. Compute the value of the integral pz correct to three significant figures 
by Simpson's one-thrid rule with six sub-intervals. 

15. Compute the integral js, by Simpson’s one-third rule taking four sub- 
intervals and use it to compute the approximate value of []. 


16. Discuss numerical differentiation using Newton’s forward difference 
interpolation formula and Newton’s backward difference interpolation 
formula. 


3 
17. Use the following table of values to compute f f(x)dx: 
0 


x 0 I 2 3 
f(x) L6 3.8 82 154 
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! ' " : — Numerical Integration and 
18. Use suitable formulae to compute y'(1.4) and y'(1.4) for the function y Numeric Du rerendadon 
f(x), given by the following tabular values: 


x 14 1.8 2.2 2.6 3.0 
y 0.9854 0.9738 0.8085 0.5155 0.1411 NOTES 


d : ES 
19. Compute a and ; 7 for x =1 where the function y = f(x) is given by the 
X 


following table: 


x 12 3 4 5 6 
y 18 27 64 125 216 


20. A rodis rotating in a plane about one of its ends. The following table gives 
the angle 0 (in radians) through which the rod has turned for different values 


: T . dO . 
of time ¢ seconds. Find its angular velocity p and angular acceleration 
2 


0 
d at t= 1.0. 


t secs 00 02 04 06 08 1.0 
0 radians 0.0 0.12 0.48 1.10 2.00 3.20 


. , 4 2 . 
21. Find E and ; 7 atx = 1 and at x = 3 for the function y = f(x), whose 
X 


values in [1, 6] are given in the following table: 


x 1 2 3 4 5 6 
y 2.7183 3.3210 4.0552 4.9530 6.0496 7.3891 


d à 
22. Find 2 and ; 7 at x = 0.96 and at x = 1.04 for the function y = f(x) 
X 


given in the following table: 


x 0.96 0.98 1.0 1.02 1.04 
y 0.7825 0.7739 0.7651 0.7563 0.7473 
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BLOCK - III 
PDE, ODE AND EULER METHODS 


UNIT 9 PARTIAL DIFFERENTIAL 
EQUATIONS 


Structure 
9.0 Introduction 
9.1 Objectives 
9.2 Partial Differential Equation of the First Order Lagrange’s Solution 
9.3 Solution of Some Special Types of Equations 
9.4 Charpit’s General Method of Solution and Its Special Cases 
9.5 Partial Differential Equations of Second and Higher Orders 
9.5.1 Classification of Linear Partial Differential Equations of Second Order 
9.6 Homogeneous and Non-Homogeneous Equations with 
Constant Coefficients 
9.7 Partial Differential Equations Reducible to Equations with 
Constant Coefficients 
9.8 Answers to Check Your Progress Questions 
9.9 Summary 
9.10 Key Words 
9.11 Self Assessment Questions and Exercises 
9.12 Further Readings 


9.0 INTRODUCTION 


In this unit, you will learn about partial differential equations. Partial differential 
equations are used to formulate, and thus aid the solution of, problems involving 
functions of several variables. Partial differential equations often model 
multidimensional systems. 


You willlearn various methods to solve partial differential equations of first, 
second and higher orders. 


9.1 OBJECTIVES 


After going through this unit, you will be able to: 
e Derive partial differential equations ofthe first order Lagrange’s solution 


e Know some special type of equations which can be solved easily by methods 
other than the general method 


e Describe Charpit's general method of solution and its special cases 


Partial Differential 
Equations 


NOTES 
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e Solve partial differential equations of second and higher orders 
e Classify linear partial differential equations of second order 


e Explain homogeneous and non-homogeneous equations with constant 
coefficients 


e Reduce partial differential equations to equations with constant coefficients 


9.2 PARTIAL DIFFERENTIAL EQUATION OF THE 
FIRST ORDER LAGRANGE'S SOLUTION 


Lagrange's Equation 


The partial differential equation Pp + Qq = R, where P, Q, R are functions of x, y, 
z,is called Lagrange's linear differential equation. 


- . a dy dz 
Form the auxiliary equations -p = o =- and find two indpendent solutions 


ofthe auxiliary equations say u(x, y, z) = C, and v(x, y, z) = C,, where C, and C, 
are constants. Then the solution of the given equation is F(u, v) =0 or u= F(v). 


For example, solve (y? 4 z?)p — xyq = —xz 
The auxiliary equations are 


dx dy dz 
ee x = 
y +z —Xy -xz 


(9.1) 


Taking the last two equations, we get 


Integrating we get log y= log z + constant 


of cis 


Zz 


Each of the Equations (9.1) is equal to 


xdx + ydy + zdz 


x(y! +z’) - xy - xz? 


. xdx + ydy + zdz 
1.€. See 
0 
i.e. xdx + ydy + zdz = 0 


Hence after integration this reduces to 
xX+y +z =C, 


Hence the general solution ofthe equation is 


Example 1: Solve x’ e Ey? eae (x+y)z 
Ox Oy 


Solution: The auxiliary equations are 
dx dy dz 


Que 2 


x y (x+ y)z 


; dx — dy dz 

d a ea^ Pye 

. dx — dy dz 

le. ERA LEE 
x-y A 


ie. log(x—y)-logz + constant 


x-y _ 
z =C 
d d 
Also a 
x y 
1 1 
Hence — — = — —-Fconstant 
x y 
iol 
y x E 


Hence the solution is, F E = HE =0 
y X Z 


Example 2: Solve (x? — yz)p + (? — zx)q = z — xy 


Solution: 


The subsidiary equations are: 


dx dy dz 


2 2 2 
X^ — yz y —zx z' —xy 


dx — dy d(x— y) 


x -y-Q0^-z)  (x-y)(x+y+z) 


d(y —-z) 


—«(v-zYx*y-z) 
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Partial Differential d(x— y) B d(y —z) 


Equations 
x-y y-z 
Integrating log (x-y) = log (y —z) + log C, 
NOTES 
X—y E C, 
yer!’ 


Using multipliers x, y, z, each of the subsidiary equations 


xdx + ydy+zdz _ xdx + ydy + zdz 
x -y-z-3xz (x+y+z (x +y’ +z xy- yz- zx) 


f dx + dy + dz 
and is also equal to 2 —— —; 2 
X? +y tz -yz-zx-xy 


xdx + ydy + zdz dx + dy + dz 
x+y+z 7 1 


xdx + ydy + zdz = (x + y + z)d (x +y * z) 
On Integrating, we get 


X +y +z =(x+y+z +C, 
xy +yz + zx = Č’, 


From Equations (1) and (2), we get the solution, 


"(2 —À xya yz4 J = 0, where F is arbitrary. 
YZ 


Example 3: Solve (a—x)p + (b-y)q =c-z 
Solution: 


The subsidiary equations are: 


From Equation (1) 


dy dz 
y-b  z-c 


log (y — b) = log (z- c) + log C, 


-b 
-eg 


z-c 1 
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(1) 


Q) 


(1) 


Also Partial Differential 
Equations 


dx dy NOTES 


x—a y-b 
log (x — a) = log (y - b) + log C, 


Be at 
y-b) € 


The general solution is 


(z= =) E 
z—-ce y-b 


Example 4: Solve (y -z)p + (z- xg 2 x -y 


Solution: 
The auxiliary equations are: 
dx dy az dx + dy + dz 
y-z z-x x-y 0 
dx + dy + dz ^0 
Integrating we get, x +y +z= C, 


Also each ratio 


xdx + ydy + zdz 


x(y - z) * y(z - x) * z(x - y) 


| xdx + ydy + zdz 
0 
xdx + ydy + zdz = 0 
On integrating, we get, 
e+y+2=C, 
The general solution is 


F(xtytz,x*+y? +27) =0 


Example 5: Solve (mz — ny)p — (nx —Iz)q = ly — mx 
Solution: 


The auxiliary equations are: 


dx dy dz 


mz—ny nx-li ly—mx 
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Partial Differential Using multipliers x, y, z, we get each ratio 
Equations 
xdx + ydy + zdz 
~ x(mz — ny) + y(nx — Iz) + z(ly — mx) 


NOTES 
_ Xdx * ydy + zdz 
B 0 
E: PEP re =C; 
Also by using multipliers /, m, n, we get each ratio 


_ Idx +mdy + ndz 
i 0 


lx * my * nz - C, 
-. The general solution is 
F(x +y +2°,lk+my+nz)=0 


Example 6: Solve x (y — z)p + y(z ^ x)q = z(x — y) 


Solution: 
The auxiliary equations are: 
dx dy dz 
Xy-xz  yz—-yx zx-zy 
_ dx dy dz 
0 
dx + dy + dz «0 


(1) 


On integrating, we get, x +y tz — C, 


dx o y dg;  dx,dy, 
a Y uo x y z 


y-z z-x x-y 0 
dx dy dz 
=> —+——+— = 
X y» 2 


On integrating, log x + log y + logz=log C, 
xyz = C, (2) 
From Equations (1) and (2), the general solution is, F(x + y +z, xyz) - 0 
Example 7: Solve x?p + y?g ^ z? 
Solution: 
The auxiliary equations are: 
duode 


Partial Differential 


dx T dy Equations 
We 
x! y 
a NOTES 
XE =-—+C, 
x y 
1 
y x 
Also 
dy dz 
2077 E. 
y Z 
1 1 
B^ = -—4+C, 
Ed 
Z 32 
The general solution is 


Example 8: Solve (y +z)p -(zt-x)q-2x-*y 
Solution: 


The auxiliary equations are 


dx dy — dz 


ytz z+x x+y 


dx — dy dy—dz  dz-dx 


x-y | y-z z-x 


Le. 


dx + dy + dz 
x 2(x+y+z) 


Considering first two members and integrating, we get 


*-y 
y-z 


=C, 


Considering first and last members and integrating, we get 


1 
log(x—y) = J log(x + y +z) + log C, 
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log Gc =log C; 
Xty-cz B2 
LR e 
IN =log Cj 
-. The general solution is 


db eo 


y-z x+y+z 


9.3 SOLUTION OF SOME SPECIAL TYPES OF 
EQUATIONS 


Wave Equation 


For deriving the equation governing small transverse vibrations ofan elastic string, 
we position the string along the x-axis, extend it to its length L and fix it at its ends 
x= 0 and x = L. Distort the string and at some instant, say ¢ = 0, release it to 
vibrate. Now the problem is to find the deflection u(x, f) of the string at point x 
and at any time t> 0. 


To obtain u(x, t) as the result ofa partial differential equation we have to 
make simplifying assumptions as follows: 


1. The string is homogeneous. The mass ofthe string per unit length is constant. 
The string is perfectly elastic and hence does not offer any resistance to 
bending. 

2. The tension in the string is constant throughout. 

3. The vibrations in the string are small so the slope at each point remains 
small. 

For modeling the differential equation, consider the forces working on a 
small portion ofthe string. Let the tension be 7; and T, at the endpoints P and Q 
ofthe chosen portion. The horizontal components ofthe tension are constant 


because the points on the string move vertically according to our assumption. 
Hence we have, 


T, cosa = T, cosp = T = const (9.2) 
The two forces in the vertical direction are — T, sin a and T. 5 sinp of T, 


and T, . The negative sign shows that the component is directed downward. If p 


is the mass of the undeflected string per unit length and Ax is the length of that 
portion ofthe string that is undeflected then by Newton ’s second law the resultant 
ofthese two forces is equal to the mass pAx ofthe portion times the acceleration 


0^ul0t? 


Oru 


T, sin B — T, LUE 
t 
By using Equation (9.1), we can divide the above equation by 


T, cosp = T, cosa = T , to get 
T,snp T sina | 


= tan D — tana = —— —- 9.3 
T,cosB T,cosa P T at a 


Since tan a and tan p are the slopes of the string at x and x + Ax, therefore 


tana = EJ n and tanp = EJ 
Ox 


Ox 
By dividing Equation (9.3) by Ax and substituting the values of tan ot and 


tan B, we have 
slam 
Ax|\ ax | V Ox 


As Ax approaches zero, the equation becomes the linear partial differential 
equation 


x+Ax 


iE 


= Cc” —— c= (9.4) 


which is the one-dimensional wave equation governing the vibrations of an 
elastic string 


Ou ĝu 
uu m Es 9.5 
at? ex? ( ) 
To determine the solution we use the boundary conditions, x = 0 and 
x=L, 
u(0,t)=0, u(L,t)=0 — forallt (9.6) 


The initial velocity and initial deflection of the string determine the form of 
motion. If f(x) is the original deflection and g(x) is the initial velocity, then our initial 
conditions are, 


u(x,0)= f(x) (9.7) 
and 

Ou 

as g(x), (9.8) 


Partial Differential 
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Partial Differential I. Now the problem is to get the solution of Equation (9.5) satisfying the 


id conditions (9.6)-(9.8). 
By using the method of separation of variables, verify solutions ofthe wave 
NOTES Equation (9.5) ofthe form 
u(x,t) = F(x)G(t) (9.9) 


which are a product of two functions, F(x) and G(t). Note here that each 
ofthese functions is dependent on one variable, i.e., either x or t. By differentiating 
Equation (9.9) two times both with respect to x and t, we obtain 


Ot? 


By substituting these values in the wave equation we get, 


x eu . 
FG and p F'G 
Ox 


FG =c°F'G: 
Divide this equation by c? FG, to get 
G F' 
eG BT 
The equations on either side are dependent on different variables. Hence 


changing x will not change G and changing ¢ will not change F and the other side 
will remain constant. Thus, 


G F' 

CG TF E 
or 

F" -kF =0 (9.10) 
and 

G - c'kG - 0- (9.11) 


The constant k is arbitrary. 
Now we will find the solutions of Equations (9.10) and (9.11) so that the 
equation u — FG fulfills the boundary conditions (9.6), that is, 
u(0,t)= F(0)G(r) - 0, u(Z,t)= F(L)G(r) - 0 for all t. 
When G=0, thenu=0. 
Therefore, G # 0 and 
(a) F(0) =0, (b) F(L) - 0 (9.12) 
For k = 0 the general solution of Equation (9.10) is F = ax + b, and from 
Equation (9.12) we obtain a = b = 0 and hence F = 0, which gives 


Self-Instructional 
230 | Material 


u = 0. But for positive value of k, i.e., k= u’ the general solution of Equation 
(9.10) is 


F = Ae"* +Be™, 

and from Equation (9.12), we again get F 2 0. Hence choose k < 0, i.e., 
k = -p° . Then the Equation (9.10) becomes, 

F"+p’F=0 
The general solution of the above equation is, 

F(x)= Acos px + Bsin px. 
Using conditions of Equation (9.12), we have 

F(0- 4-0 and F(L)=Bsin pL=0 

B =0 implies F'=0. Thus we will take sin pL =0, giving 


nu 
pL=nn, sothat p= T where n is an integer (9.13) 


For B= 1, we get infinitely many solutions F (x) =F (x) , where 


F,(x)= sin x (n =1,2,---). (9.14) 

These solutions satisfy Equation (9.12). The value of the constant k is now 
limited to the values & — p? = -(nm / LÝ , resulting from Equation (9.13), so 
Equation (9.11) becomes 


G+NG=0 where À, mx (9.15) 


A general solution is 
G, (t) - B, cos,,t +B, *sind,t. 


Hence solutions of (9.5) satisfying (9.6) are u, (x,t) = F, (x)G, (t), written 


as 
u, (x,t) = (B, cos A,t ^ B, *sinA,r)sin "x (n = 12,---). (9.16) 


Functions of these type are called the eigenfunctions and the values À, = 
cnt/L are called the eigenvalues of the vibrating string. This set of A, is known as 
spectrum. 


Each u, represents a harmonic motion with frequency A, /2a = cn/2L 
cycles per unit time. This motion is known as the nth normal mode of the string. 


Partial Differential 
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Partial Differential The first normal mode is referred as the fundamental mode (n = 1) while the 


id others are known as overtones. 
A single solution u, (x, t) will not satisfy the initial conditions (9.7) and (9.8). 
NOTES But, u, is a solution of Equation (9.5), since the equation is linear and 
homogeneous. To obtain a solution that satisfies Equations (9.7) and (9.8), consider 
the following infinite series, 
u(x,t) = X, (x,t) 23 (B, cos A,t *- B, *sin À,t)sin 7 ; 
n-l n-l 
where 4, =cna/L (9.17) 
Therefore, 
. nn 
u(x,0)= ŽB, sinx = f(x). (9.18) 
n=l 


Select the coefficients B,'s so that u(x,0) becomes the Fourier sine series 
of f(x). Thus, from Equation (9.10), 
2; nnx 
B, == | fix)sin — dx, n =1,2,---. (9.19) 
um D 
Similarly, by differentiating Equation (9.17) with respect to ¢ and using 
Equation (9.8), we get 


Ou 


z |xc B, sink, t+ B, * X, cos isi 
a L ds 


n=l 


= Y, 2 sin = = g(x) 


n=l 
B, *’s should be selected so that for t= 0 the partial derivative ĝu / ôt 
becomes the Fourier sine series of the function g(x). So from Equation (9.10), 


2f . Hx 
B,*A,- 7 [g()sin77 dr 


0 


Here, since A, =cnt/L, 


n 


L 
B,*- 2 Í e(x)sin Za neos (9.20) 
Cnn, L 


Now, let us consider the case when the initial velocity g(x) is zero. Then the 
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Partial Differential 


u(x,t) = >B, cosà tsin =, A, a (9.21) Equations 
n=l L L 
We know that, 
NOTES 
cnt . nn l|. jann . (nt 
cos tsin — x =—| sin (x ct) + sin = (x 2 ct) 
L L 2 L L 


Therefore Equation (9.21) becomes, 


u(x, t) = 22 B, sin| (x- «) t : Y B, sin| 2 (x — «) 
n-l n=l 


The above two series are generated by substituting x — ct and x + ct, 
respectively, for the variable x in the Fourier sine series given in Equation (9.18) 
for f(x). Thus 


ust)» Lf *(e=et)+ f Ger) (9.22) 


where /* is the odd periodic extension of f with the period 2L. By 
differentiating Equation (9.22) we see that u(x, f) is a solution of Equation (9.5), 
given that f(x) is twice differentiable on the interval 0 < f(x) < L and has one-sided 
second derivatives at x = 0 and x = L, which are zero. u(x, t) is obtained as a 
solution satisfying Equations (9.6) — (9.8). 


If f'(x) and f"(x) are merely piecewise continuous or if the one-sided 


derivatives are not zero, then for each t there will be finitely many values of x at 
which the second derivatives ofu appearing in Equation (9.5) do not exist. Except 
at these points the wave equation will still be satisfied. We can then regard u(x, f) 
as a generalized solution. 


Example 9: Determine the solution ofthe wave Equation (9.5) corresponding to 
the following triangular initial deflection, 


and zero initial velocity. 
Solution: Since g(x) =0,wehave B,* =0 in Equation (9.17). 


The B, are given by Equation (9.11) and thus Equation (9.17) takes the 


u(x jc LN ; Sin cag uk 
LO ee ae Y È 


Self-Instructional 
Material 233 


Partial Differential 
Equations 


NOTES 


Self-Instructional 
234 Material 


9.4 CHARPIT'S GENERAL METHOD OF 
SOLUTION AND ITS SPECIAL CASES 


Charpit's method is used to find the solution of most general partial differential 
equation oforder one, given by 


Fx, y, z, p, q) - 0 (9.23) 
The primary idea in this method is the introduction of a second partial 
differential equation of order one, 


fo y,zpqa)-0 (9.24) 
containing an arbitrary constant ‘a’ and satisfying the following conditions : 
1. Equations (9.23) and (9.24) can be solved to give 


p = p(x, y, z,a) and q = q(x, y,z,a) 
2. The equation 


dz = D(x, y,z,a)dx + q(x, yz, a My (9.25) 


is integrable. 
When a function ‘f satisfying the conditions 1 and 2 has been found, the 


solution of Equation (9.25) containing two arbitrary constants (including ‘a’) will 
be a solution of Equation (9.23). The condition 1 will hold if 


OF of 
y= AFF) |a P| 40 
Ap.q) JE F (9.26) 
Oq ôq 
Condition 2 will hold when 
o aa 
Oz Oz Oy Ox 
Oq oq | Op op 
p= + 
a P Ox Oz Oy O27) 


Substituting the values of p and q as functions of x, y and z in Equations 
(9.23) and (9.24) and differentiating with respect to x 


OF | OF cp _ OF oq o 
Ox Op Ox ôq Ox 


a Lh LY, Sao 
Ox Op ox ðq Ox 


Therefore, 


OF Of OF Of \0q _ OF Of _ OF of 
Op Oq OqOpjOx Ox Op Op Ox 


Oq_1)OF Of OF of 
Ox J|Ox Op Op ox 


OF Of : OF of 
Oy ôq Og Oy 


õp 1l 
oz J 


ôq 1jJOFOf OF of 
Oz J\|0z Op Op Oz 


Substituting the values from Equation (9.28) in Equation (9.27) 


1 | e of OF ze of OF Z) 


Op ] 
Similarly öy = 


OF of i OF of 
Oz ôq Og Oz 


and (9.28) 


F Oz Op Op Oz 


af 


OF |Q OF \ ð OF OF |Q 
omis ee cud ege. UE 
Op ) Ox ôq ) Oy Op ôq } Oz 


Ox Op Op Ox 


OF of OF 2) 


OF Of " OF of 
Oz ðq Op Oz 


Oy Oq Oq Oy 


OF OF \A OF OF \d 
al fi DE, fE, = Ee (9.29) 


Oz  0OxjO0p Oy ) Og B 
The Equation (9.29) being linear in variable x, v, z, p, q and f has the 
following subsidiary equations: 
dx č dy _ dz 7 dp » dq 
OF OF OF OF OF OF OF OF 
Op ôq Op Oq dx Oz Oz 
If any of the integrals of Equations (9.30) involve p or q then it is of the form 
of Equation (9.24). 


Then we solve Equations (9.23) and (9.24) for p and q and integrate Equation 
(9.25). 


Partial Differential 
Equations 


NOTES 
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Partial Differential Example 10: Get complete integral ofthe equation, 


Equations 
p! *4! -2px -2qy * 2xy - 0 (1) 
Solution: The subsidiary equations are 
NOTES 
dp dq dx dy 
— p= E= 2 
=p) 206999) Apk) gy) e 
dp + dq B dx+ dy 


P 2yt2x-2p-2q  2x-2y-2p-2q 

dp + dq = dx + dy 
Integrating, we get 

ptq=xtyta 

where a is constant 

(p—x)+(q-y)=a (3) 
Equation (1) can also be written as 

(p-x) +(q-y) 2G -»y 
Now {(p—x)-(q-y)} + {(p—x) + (q-y)P 

= 2p -xY *(a- y] 


(p-x)-(a- y) - 2x -y7 -a © 
Adding Equations (3) and (4), 


(p-x)= az yy -a 


2 


Or poet») a" 


Similarly subtracting Equation (4) from Equation (3) 
a 1l Jos - yy —a? 
=yt+—-—y2\x-y) -a 
q-y*z5-4N2x-y) 
dz = pdx + qdy 


or 


Leen | Oe ae C cy umm 
tene 2(x y) a E 2 2(x y) a hay 
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Partial Differential 


= Zal ey! aee y) eve) - a^ d(x - y) Equations 


On integrating 
NOTES 


2 


x+y 


z+b= «Sy foU? -aau 


where U = x — y and b is an arbitrary constant 


fede e-»-£| 


Example 11: Determine the complete integral ofthe equation 


p! +q? -2px-2gy 41-0 (1) 


Solution: The subsidiary equations are 


dx dy dp dq 
-(Q-2x) —(2g-2y) -2p -2« @) 
With 
dp dq 
pod 
On integrating, we get 
p=aq (3) 


where ‘a’ is an arbitrary constant. 


Substituting the value of p from Equation (3) in Equation (1) 
q^ (Le a?)-2a(ax « y) 1 =0 


q — (ax e y) (ax y ETT 


dz = pdx + qdy 
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Partial Differential which gives 


Equations 
dz = q(adx + dy) 


NOTES = dc y ax y) fac 9) NT 
Integrating 


z+b=—(ax+ y) Enron yy pan) 


"ss y) dic (+a) 


where b is an arbitrary constant. 


Example 12: Find Complete Integral of the following equation 


2(pq + py * ax)* x! +y?’ =0 (1) 
Solution: The subsidiary equations of Equation (1) are 
dx [| dy ||. dp | dq 
—(2¢+2y) -(2p+2x) Qa*2x) (2p+2y) e 
<. dp + dq + dx + dy-0 
Integrating 


p+q=+x+ y =constant=a (say) 


or (p+x)+(qt+y)=a (3) 


Equation (1) can be written as 
2(p +xXq + y\x-yř =0 


or (p+x\qt+y)= -26-7 


(p *x)-(a * »)- Ap * x) (a x) -4p+xXq +y) 


= Jat 2(x - yy 
Adding Equation (3) and (4), 


2(p*x)2a- 4a? +2(x- yy 
1 
or poor St sya’ eX yj 
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Subtracting Equation (4) from Equation (3) Partial Differential 


Equations 
a 1 2 2 
q=-y+—--ya +2(x-y) 
2. 2 


dz = pdx + qdy 
giving 


dz = -xdr yay) e (dr + dy) + fa" + 2(x-y) d(x- y) 
= E +y) dety) ia «26 yale y) 


Integrating the above equation, we get 


22b - (8 + y*)+a(x+ y) 2| Verdi y) 
Ks) e (ey) 
2 


+ f og y)+ 


NOTES 


- (e xy!) a(x y) 


(x - »Na^ * 2(x- y 
2 


--(e ky a(x y) 


2 


gto fe 


Example 13: Find Complete Integral ofthe equation, 
p’ +q° -2pqtanh2y — sech^ 2y 
Solution: The subsidiary equations are, 


dx dy dp 


-(2p-2qtanh2y) (-24-2ptanh2y) 0 


dq 
~ —Apqsec h^ 2y 4 Asec h? 2 y tanh 2y 
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Partial Differential . dp =0 


Equations 
or p= constant = a (say) 
Therefore 


NOTES 
q^ -2atanh2y.q +a’ - sech^2y =0 


q - atanh 2y +a’ tanh? 2y — a? +sech?2y 


- atanh2y 4 J1— a? sech2y 


dz — pdz * qdy 
gives 
dz = adx + ls tanh 2 y + J«1— a? sec h2y Jy 


- afaxs log cosh 2 t J1- a? sec A2 ydy 


Integrating 


e" +e 


2 2v 
= ax ^ logcosh2y + V1— aes S E 


= ax+ Slog cosh 2y + ie e"). 


Example 14: Find Complete Integral 


zb ax logcosh2y + vi - a n eee 


xy +3yq = 2(z — xq?) 


Solution: The subsidiary equations are 


dx _ dy dp dq 
=x ve 4q p-2p+4xq° ~ 3q-2q 
dd cor 

q -x 


=> qx= constant =a 


a 
=> q0-—— 

x 
Substituting in Equation (1) we get 


D 2(z - a?) 2 
x x 
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(1) 


= Partial Differential 
de = pats * qdy uo 
Az-a*) 3ya a 
ie =| | - ) = laeta 
NOTES 
Multiplying by x? 


x°dz = 2x(z -a? Jax —3yadx + axdy 


c2 
ie. va? - | = —3aydx + axdy 
ý x 


z-a’ a 3a a 
i.e., d| 2 )- ; dy Pas =f 4 
x x x 


Z-a ay 
On integrating , we get —,— => +b 
x x 


» : 
or 2 = (a + z) + bx? where, a and b are arbitrary constants. 


Check Your Progress 


Define Lagrange’s linear differential equation. 

What are the assumptions for solving the wave equation? 
What is the nth normal mode of the string? 

Where is Charpit’s method used? 


Be tee MS 


9.5 PARTIAL DIFFERENTIAL EQUATIONS OF 
SECOND AND HIGHER ORDERS 


The general form ofa linear differential equation of nth order is 


n n-l n-2 
g a ee ap pa 
dx" dx"! dx"? dx 


where P}, P, ..., P, and Q are functions of x alone or constants. 


The linear differential equation with constant coefficients are ofthe form 


d" y d'ly d"3y dy 
Po tert tae tiny 2 (9.31) 


where P}, P», ..., P, are constants and Q is a function of x. 


The equation 
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Partial Differential n n-l n-2 
EK d'y d'y d' ^y dy E. 
Equations p +P e + P, EXT Sera uj Pc (9.32) 
is then called the Reduced Equation (R.E.) of the Equation (9.31) 
NOTES Ify =y x), y =y X), -Y =y, (x) are n-solutions of this reduced equation, 


then y — cy, * c; y; +... + c, y, is also a solution ofthe reduced equation where 
Cis Coy ..., C, are artbitrary constants. 

The solution y = y, (x), y = y; (x), y ^ y4 Œ), -Y =Y, (x) are said to be 
linearly independent if the Wronskian of the functions is not zero where the 
Wronskian ofthe functions y,, y»... y,, denoted by W(y,, y», ....V,,) is defined 
by 


A Y2 Y3... Yn 
yi y Y3 Yn 
WQuys-yJ- x x ys y 


-1 -1 -1 1 
DES E E 


Since the general solution ofa differential equation of nth order contains n 
arbitrary constants, u = cjy, * CY, +... + c, y, isits complete solution. 
Let v be any solution ofthe differential Equation (9.31), then 


y dv 
— +P, a tuet a 2t Bv-2Q (9.33) 
Since u is a solution of Equation (9.32), we get 


d"u d'y d'^?y du 
+B +P, t..+P ,—+Pu=0 9.34 
dx" 1 dx"! 2 dx" n-l dx + nl ( ) 


Now adding Equation (9.33) and (9.34), we get 


n n-l n-2 
QE qu CE E 3 - 
dx” dx” dx™ 


This shows that y = u + v is the complete solution of the oo (9.31). 


E+ Pu v)-Q 


Introducing the operators D for £ aD for ^ D’ for 2 etc. The Equation 

(9.31) can be written in the form 
D'y + PD ly + PD? y... P, |Dy*yP,-Q 

or  (D'eBp D  ePD*^4. £P ;D+P)y=0 

or  F(D)y=Qwhere F (D) - D' + PD! P,D"*+......+P,,D+P 

From the above discussions it is clear that the general solution of F (D)y = Q 
consists of two parts: 

(Ò The Complementary Function (C.F.) which is the complete primitive of the 

Reduced Equation (R.E.) and is ofthe form 


Self-Instructional Y =c y tC y, +... Fe, y, containing n arbitrary constants. 
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(ii) The Particular Integral (P.I.) which is a solution of F(D) y= Q containing 
no arbitrary constant. 


Rules for Finding The Complementary Function 


Let us consider the 2nd order linear differential equation 


dy dy 
PE XH d +Py=0 (9.35) 


Lety=A e” bea trial solution of the Equation (9.35); then the auxiliary Equation 
(A.E.) of Equation (9.35) is given by 


m^ * Pim+ P,=0 (9.36) 


The Equation (9.36) has two roots m=m,,m=m,. We discuss the following 
cases: 


(i) When m, 2 m,, then the complementary function will be 
y= cen + Go e" where c, and c, are arbitrary constants. 
(ii) Whenm,=m,, then the complementary function will be 
y= (c, +e, x) e" where c, and c, are arbitrary constants. 
(iii) When the auxiliary Equation (9.36) has complex roots of the form a + ip 
and o1— iD, then the complementary function will be 
y 7 €" (c, cos B x * c, sin B x) 
Let us consider the equation of order n 


n-l n-2 
ope ae 
dx" dx" dx" 
Let y =A e" bea trial solution of Equation (9.37), then the auxiliary equation 


is 


+ AP,» S (9.37) 


iP m+ Pym ^ LSEP. v m*P.-0 (9.38) 
Rule (1): If m,, m», m,, ..., m, be n distinct real roots of Equation (9.38), then 
the general solution will be 
gu gnis tcje m^x 4. cg Mop eee” 
where c,, c», c,.....c, are arbitrary constants. 


Rule (2): If the two roots m, and m, of the auxiliary equation are equal 
and each equal to m, the corresponding part of the general solution will be (c, + 
c, X) e” and if the three roots m,, m4, m; are equal to o the corresponding part 
of the solutionis (c, + cx + Gar) e™ and others are distinct, the general solution 
will be 
6 
p= (cP ex) e" + (cyt cyt CH) e E PR, Ati ee oa 

Rule (3): If a pair of imaginary roots o + iB occur twices, the corresponding part 
of the general solution will be 


e™ [(c] * e,x) cos Bx + (c, + cx) sin Bx] 


Partial Differential 
Equations 


NOTES 
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Partial Differential and the general solution will be 


Equations ; 5 
y =e™ [Ce Hex) cos Bx + (c3 + ex) sin Bx] Fee" E unre” 
where c, c»... c, are arbitrary constants and m;, mg, ...., m, are distinct real 
NOTES roots of (9.38). 


Rule (4): If the two roots (real) be m and — m, the corresponding part of the 
general solution will be c, e"* - c,e 


= c4 (cosh mx + sinh mx) + c, (cosh mx — sinh mx) 

cu LEE r ERS ^ 

= ci cosh mx + c^ sinh mx where cj — c, + cy, C=C, —C, 

and general solution will be 
. 3 4 
y = c cosh mx + c’, sinh mx + c,2^ * + c) e” *-E, t Ce 

where c}, c5, C3, .....c, are arbitrary constants and m,, m, ... m, are distinct real 
roots of Equation (9.38). 
Rules for Finding Particular Integrals 


Any particular solution of F (D) y — f(x) is known as its Particular Integral (P.I). 
The P.I. of F(D)y = f(x) is symbolically written as 


NE . 
P.I. = FO) {f (x)} where F(D) is the operator. 


1 
The operator F(D) is defined as that operator which, when operated on 


f(x) gives a function 6 (x) such that F (D) 6 (x) =f Œ) 


i.e., PS (£69) -6 6) (C P.) 


F (D) [x9] =f (x) | -L fo) = 00) 


F(D) FD) 
Obviously F (D) and 1/F(D) are inverse operators. 


Case I: Let F (D) =D, then 5 f= f f(x) dx. 
Proof: Let y= Zro , operating by D, we get Dy=D. 7, e or Dy =f (x) or 


& = f(x) or dy =f (x) dx 
Integrating both sides with respect to x, we get 
y= f f(x) dx, since particular integrating does not contain any arbitrary constant. 


Case II: Let F (D) = D — m where m is a constant, then 


1 
——{f(x)}=e™ [e fax. 
D-m 
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Partial Differential 


Proof: Let $ L z LU G9) =y, then operating by D — m, we get EGHaRons 


(D — m). 69) = (D - m) y 


NOTES 
ed 
or fo) comp 
or 2 -my =f (x) which is a first order linear differential equation and I.F. = 
[max —mx 
€ =e 


Then multiplying above equation by e "* and integrating with respect to x, we 
get 


ye ™= f f(x)je "dx, since particular integral does not contain any arbitrary 


constant 
or gene f f G)e "dx. 
1 
Note: If = 4 A D +—“" where a, and m; (i= 1, 2, ..., n) 


+ + 
F(D) D-m D-m, D-m 
are constants, then 


n 


roy 0 " ae" fee "dx + aye" f f G)e "dx + 


NE: a,e"* | fo)e "dx 


= Y ae" | f (x)e "dx 
i=l 


We now discuss methods of finding particular integrals for certain specific types 
of right hand functions 
Type I: f(D) y 7 e"* where m is a constant. 
1 E o e* 
Then P.I. F(D) tery Fim 


If F (m) =0, then we replace D by D+ min F (D), 


if F (m) #0 


1 mx = mx 1 
PI. je } =e FO ra) 


Example 15: (D? - 2D? — 5D + 6) y = (e™ + 3) + e cosh x. 
Solution: The reduced equation is 
(D? -2D? 5D * 6)y 20 (1) 
Let y=Ae” bea trial solution of (1). Then the auxiliary equation is 


m? —2 m? — 5m * 6 0 or n? — m? - m? ^ m- 6m ^ 6-0 
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Equations 


NOTES 
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or m? (m — 1) -m (n —1) -6(m—1)-0 

or (m — 1) (m? — m-6) 20 or (m— 1) (m? -3m + 2m - 6) 0 
or (m—1)(m—3) (m+ 2)=0 or m=1, 3, -2 

.. The complementary function is 


y=ce + ee” tc, e ?* where Cy, C5, C4 are arbitrary constants. 


X X +4 =x. 
Again (e + 3)? + e* cosh x = e^" +6 e™ +9 + e [E F 


-. The particular integral is 


= 1 3 4x 13 2x ox] 
d a UO NOE 
EN 1 [3 4x M "X 
(D-1(D-3YD*2)|2 2 
23 1 ge, 13 1 "S 
2 (D-1D-3YD42) 2 (D-I(D -2YD -3) 
+ 9 1 e 
(D-1)(D-3)(D +2) 
_ 3 an _B p^ 
2(4-1)(4-3)(4-2) 2 (2-1))2+2)(2-3) 
0.x 
+9 £ 
(0 —1)(0—3)(0- 2) 
$.eff nB w^ e? 
= + +9 
23.1.6 Dict ely  DŅD(3).2 
4x 
68 33 
12 8 2 
Hence the general solution is 
y-C.F. + PI. 


4x 

3x 2x, € 135. 3 
=c e bow toe 4 e^ ts, 
l 2 3 12 8 2 


1 te" =x m te" 


Notes: 1. When F (m) = 0 and F'(m) £ 0, P.I. = FO FD) 


1 Partial Differential 


2. When F (m)- 0 F'(m) = 0 and F"(m) + 0, then P.I. = FD) (e"" Equations 
2 mx 
e o NOTES 


and so on. 
Type II: f(x) = e"* V where V is any function of x. 
Here the particular integral (P.I.) of F (D) y ^ f(x) is 


= I mx — „Mx 1 
PL = Fy) = eam 


Example 16: Solve (D? — 5D + 6) y = x? e* 
Solution: The reduced equation is 
(D? -5D +6) y=0 (1) 
Let y= Ae” bea trial solution of Equation (1) and then auxiliary equation is 
m^ —5m + 6=0 or m*—3m-2m+6=0 
or m (m-—3)—2(m—3)-00r(m—3) (m—2)=0 
m=2,3 


-. The complementary function is 


y=c,e* +c, e* where c, and c, are arbitrary constants. 


The particular integral is 
= 1 33x) = p 2 
xe X 
Di-sD«6 (D*35 -5D43) 6. 
1 
= e 1 (- e» (x) 


D? 46D 49-5D-1546 D'«D 


à 1 
D(4 D) 


TOR PI + Dy xh 


3x 
EI qAISD Den 


ex x? 
= {x 2x42} =6 | -x +2x 
D 3 


Hence the general solution is 
y=C.F + PI. 


3 
x 
= ce? + eye” + ge g =x" + 2x), 


Recall: (i) (1+ x)! = 1 -x +x- txt... 


GN (1-91 txt oo tt... 
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Partial Differential Type III: (a) F (D) y = sin ax or cos ax where F (D) = (D?). 


Equations 


Here PI.= FD) {sin ax} = TET sin ax (if @ (— a?) z 0) 
NOTES or P.I. = aD {cos ax} = TERT cos ax (if @ (a?) z 0) 


[Note D? has been replaced by — a? but D has not been replaced by — a.] 
(b) F (D) y = sin ax or cos ax and F (D) = 6 (D?, D) 
Hee: PS "ane = = undjeli o sad 
F(D) o(D*, D) 6C- a^, D) 
if 6—a,D)z0 


—— {cos ax} = oe ax} = co. eds ax) 


i PEP 1 $D’, D) o(-a?, D) 


if (-a’,D) #0 


(c) F(D) y ^ sinax or cos ax and F(D) = wo) 
Q(D^) 
Here P.I. = —— {sin ax} = OD sin aj = YO cis en if O(a?) #0 
FD) (D?) $(-a?) 
or y= dM = VES {cos ax} 


"es tees ax} ifó (- a?) #0 


(d) F (D) y= sin ax or cos ax, F (D) = n but ó (-a*) =0 


Here P.I. = sin ax or cos ax sin ax or cos ax 
FU» D) { petu FO D 1 } 
! : y : : e? 2g ha 
Alternatively, sin ax and cos ax can be written in the form sin ax — F 
l 
aix te aix 


and cos ax = Ê , then find P.I. by the method of Type I. 


Example 17: Solve (D^ + 2D? + 1) y= cos x. 
Solution: The reduced equation is (D^ + 2D? + 1) y=0 
Let y= Ae” be atrial solution. Then the auxiliary equaiton is 
m^ +2m?+1=0 or (m? - DP 20 or m=+i,ti 
'. C.F. = (c, + cx) cos x + (c4 + cx) sin x where c}, c5, c, and c, are 
arbitrary constants. 
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— — — —— {cos x} 
D +2D°? +1 


Partial Differential 
Equations 
1 
= x— — {cos x} 
4D" +4D NOTES 
[Le 0(D?) = D' - 2D? +1 
2 EN 1 mM 
$C) 1-2: 17 0, then zr 069) =r EO] 
_x 1l ET WP. 
= Y eo Ye "id 
_ x x? cosx x? 
miri {cosx}=—. = cos x 
4 3D°+1 4` -3+1 8 
Hence the general solution is 
y=C.F.+ PI. 


= (c, + cx) cos x + (c4 + cx) sin x — aom 
Example 18: Solve (D? — 4)y = sin 2x. 
Solution: The reduced equation is 
(D? -4y 20 
Let y= Ae"* bea trial solution and then auxiliary equation is 
m -4-0-2m-£2 
The complementary function is 


y7c, e" * c, € ?* where c,, c, are arbitrary constants. 
The particular integral is 


1 : 1 i 
y? -—-— {sin 2x} = T sin2x [Replace D? by- 22] 
D*-4 - 4 


1 
= — —sgin2x 
8 


The general solution is y= C.F. + P.I. = c,e?* + oN a — —sin2x. 
Example 19: Solve (3D? + 2D — 8)y = 5 cos x. 
Solution: The reduced equation is 
(3D? -2D-8)y-0 
Let y= Ae” be a trial solution and then the auxiliary equation is 
3m? + 2m - 8 2 or 3m? + 6m - Am - 8 - 0 


or 3m (m + 2) -4 (m + 2) 20 or (m + 2) 8m - 4) =0 
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Equations or m — -— 25 m = 


w| A 


.. The complementary function is 


NOTES A l 
y= £a + ce? when cand c, are arbitrary constants. 


The particular integral is 


1 
yr 
3D? +2D-8 


= 1 
{5cosx}= 5 GD-4XD +2) {cos x} 
(3D 4 4D -2) 


— 5 (3D + 4)(D - 2) ere 
[9(-1°) -16][-? - 4] 


(9D? —16)(D? - 4) dim 


{cos x} 


[D? is replaced by — I? in the denominator] k 2d 


2 5 
(7-25) (-5) 


[3D? - 6D + AD -8](cosx] = TBD? 2D -8]cosx 


2 
d 3 4 (cos x) - 2 zi (cos x) - 8cos x 
25 dx? dx 


1 : : 
= —([-3cos + 2sin x -8cosx]— : (2sin x -11cos x) 
25 25 


The general solution is 
y=C.F. + P.I. 


E 1 
=ce 2x 4 gs + 55 Qsinx -11e0s2), 


Type IV: F(D)y =x", nisa positive integer. 


1 


Ay) = ROY e 


Here PI. = 


In this case, [F (D)] ! is expanded in a binomial series in ascending powers of 
D upto D" and then operate on x” with each term of the expansion. The terms in 
the expansion beyond D" need not be considered, since the result of their operation 
on x" will be zero. 
Example 20: Solve D? (D? + D+ 1y =x’. 
Solution: The reduced equation is 
D? (D?+D+1)y=0 (1) 
Let y= Ae” bea trial solution of Equation (2) and then the auxiliary equation 
is 
m^ (m^ +m+1)=0 
cx cq sndes E 4. -1t4-3 -1+V3i 
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.. The complementary function is 


1 
zA 3 . v3 
y=(e, +c, x) e9 ve [oeste sin) 


1 NOTES 


x 3 . v3 
=c texte? E iud ets us 
2 2 


where c, c5, c4, c, are the arbitrary constant. 


The particular integral is 


: nz lgrpeptytg? 
IT NE 


s 
2 t- (D + D'«(De D'Y -(De D +...} {7} 
= ji - (D + D) + (D? «2D + D')- (De D'Y +...} {x7} 


= npo - Ox+2)+(2)+0) 


1 3 4 3 
= Syl’ - 2x} = me zd Se 


The general solution is y= C.F. + P.I. 


4 3 
X X 


- 3 ; 
=c texte M UTER +—-—., 
2 2 12 3 


Example 21: Solve (D? + 4)y =x sinx. 
Solution: The reduced equation is 
(D? + 4) y=0 
The trial solution y= A e” gives the auxiliary equation as 
m +4=0,m=+2i 


The complementary function is y = c, cos 2x + c, sin 2x 


The particular integral is y = {x sin? x} 


D? +4 
1 x 1 x x 

= =(1—cos2x)} = = _ = cos2 
E cos » à ; 508 x} 

EN! HI 1 [x e+e] 
Di«4l2] D'«4|2 2 


1 e e?* 


a, PY fx) 
i a 12) aora DA 


{x} 
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NOTES 


Self-Instructional 
Material 


ERAT 1 e 


—2ix 1 


= {x}— 
42 4 p*+4Di-4+4 


{x} 
4 p?-4Di-444 


2ix —2ix 
x e 1 e 
“3 4 DV Dy? 
api(i+2 | 4.-4p(1-2] 
4i 4i 
2ix -1 —2xi -1 
1 D D 
= 75 (i+ | o-< (1-2) (x) 
8 4 4Di 4i 4(-4Di) 4i 
2ix 2 —2xi 
1 D D D 
s PAM IE pe eese (emen 
8 4 ADi 4i -16 4(—4Di) 4i 
e 1 ( 1 | eo l 1 ) 
= —-—. x-—|+ x+ 
8 4 4Di 4i 4.4Di 4i 


x ek x? x ect x2 x 
= = = + + 
8 2.8i| 2 4i 2.8i\ 2 di 


= = sin 2x cos 2x 
2.8 
x x x 
sin 2x cos 2x 
16 32 


Hence the general solutionis y=C.F. + P. 


2 
=c¢, cos 2x + c, sin 2x + Ž-% 
l 2 8 16 


I. 


sin 2x — ~cos2x. 
32 


Example 22: Solve (D^ + D? -3D? — 5D 


Solution: The reduced equation is 


(D^ + D? -3D? -5D-2)y-0 


2) y= 3xe *. 


(1) 


The trial solution y= Ae” gives the auxiliary equation as 


m^ 4 m? 


4 3 


3m^— 5m-2-0 


or m cm 
or — m (m-1)—-3m(m- 1) -2 (m4 


3m^— 3m-2m-2-0 


-1) 


or (m+ 1) (m? -3m — 2) 2 0 or (m - 


or — (m-* D) (m? (m+ 1) - m (m * 1) 
or (m 1) (m D) (m —m—2)=0 
or (m+ 1Y (n? -2m ^ m 2) =0 
or (m 1 (m+1)(m—2)=0 


- 1) (n? + m? — n? - m-2m 2) 


~2(m+1)}=0 


m=—1,-1,-1,2 Partial Differential 
, $ , 


Equations 
The complementary function is y — (c, * c; x * Cx) er Pe ye 
The particular integral is 
1 4 NOTES 
di (DJ D-2 " 
—3e* : (3 =3e* : 


(D-14101? (D-3) D> (-3) (1- DB) "i 


ai 2 
=_e” 5(1-2] tne i 2.2 ua 


The general solution is y= C.F. + P.I. 


4 3 

2 2x x | x x 
—(c,tcec,xtcex)ytce,e"—e —+— |. 
VU pete B 3 


Type V: (a) F (D) y = xV where V is a function of x. 


= 1 = 1 ; 1 
Here P.I. roy" {> zu Oi 


Example 23: Solve (D? + 9) y 2 x sin x. 
Solution: The reduced equation is (D? + 9) y- 0 (1) 
The trial solution y= Ae” gives the auxiliary equation as 
m^*9-0orm-z3i 
^. C.F. = c, cos 3x + c, sin 3x where c, and c, are arbitrary constants. 
ES e 
F(D) 


| 


and P.I = {xsin x} where F (D) = D? +9 


1 : 1 : 
b — FO) F o» FO) {sin x} 


_ 2D | 
ee 
D «9| D?+9 


{> 2D E -d 2D |[sinx| 


{sin x} 


y= 

D +9| -1+9 D+ojl 8 f 

= xsinx 1 1 Disi xsinx l osx 
8 4-1+9 8 
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Partial Differential Hence the general solution is 


Equations 
; xsinx 1 
y= CF, + P.I. = c} cos 3x + c, sin 3x + "mE E 
NOTES (b) F(D) y=x"V where V is any function of x. 
ec cales: FQ i 
mere x CLE ra" We i FD) | FO» 


Example 24: Solve (D? -1)y =x? sin x 
Solution: The reduced equation is (D? 1)y =0 
Let y= Ae" be a trial solution. Then the auxiliary equation is 


m-—-1=0 or m=+1 


C.F. = c,€ + c,e* where c, and c, are arbitrary constants. 


SPEIL- (x? sin x} where F(D) = D?-1 
= ) 
F(D)) 1 1 ? l 
= fx- | {sin x} = {x 2 20| 5 {sin x} 
F(D)) F(D) D*-1 D^-1 
n — -2p le- + op} 2 "M 
dorsa ji jl-P-1 "J 
= fx- 2D Ha : 2pl4 1/2sin x} 
2 1 Du 
= fx- -2DH-z sin x + : | eos 
Ts 2 D’ -1 
= X. 1 
sin x — — cos x 
z e p 2 2 | 
= sin x—~cos x + s {D(xsin x + cos x)} 
2 2 D’ -1 
2 
; x 1 ; . 
= — ——sinx--—c0sx- — — {sin x + xcos x — sin xj 
2 2 D?-1 
= x sin x—~cosx + : {x cos x} 
2 2 D’ -1 
Again : {xcos x) = {x : 20| : {cos x} 
D? -1 Dest JD -1 


1 
= 4X 2D : cos x 
D? -1 -1-1 


1 1 f 
= ——x cos x + —— {-sin x} 
2 D’ -1 
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Q) 


1 1 Partial Differential 
= ——xcosx- =—_xcosx +—sinx Equations 
2 1 2 


x^. x x 1. 
SPI sin x -—cosx——cos x +—sinx 
2 2 2 2 


NOTES 

— 12. 1. 

=--x smx-xcosx +- snx 

2 2 
Hence the general solution is 
y=CF. + P.L = cje" + c,e™ = Ee ano ened sat 
2 2 

9.5.1 Classification of Linear Partial Differential Equations of Second Order 


Consider the following linear partial differential equation ofthe second order in 
two independent variables, 
2 2 2 
cee Bee i Eg ae 
Ox OxOy Oy Ox Oy 


Where A, B, C, D, E, F and G are functions of x and y. 


This equation when converted to quasi-linear partial differential equation 
takes the form, 


2 2 2 
is pe TN xui Pu =0 
Ox OxOy Oy Ox Oy 


These equations are said to be of: 
1. Elliptic type if ?—44C «0 
2. Parabolic type if 3? -44C =0 
3. Hyperbolic type if B? -44C 70 
Let us consider some examples to understand this: 
| Ou Oru „0u „ôu 
(i) € os Wi c 
Ox OxOy Oy Oy 


=> u,,—2xu,, + X2u,, - 2u, - 0 

Comparing it with the general equation we find that, 
A=1,B=-2x, C =x? 

Therefore 

B? — 44C = 2x} - 4A? = 0, y x andy #0 


So the equation is parabolic at all points. 


(i) yu t Xu. -0 
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Partial Differential Comparing it with the general equation we get, 


Equations 
A73, B-0, Ce X 
Therefore 
NOTES B^—44C =0- 4xy <0, y x andy #0 


So the equation is elliptic at all points. 
(iit) xu — yu, =0 
Comparing it with the general equation we find that, 
A=x,B=0,C=-y 
Therefore 
B’-4AC=0- 4x)? > 0, vx andy #0 
So the equation is hyperbolic at all points. 
Following three are the most commonly used partial differential equations 
of the second order: 


1. Laplace equation 
ôx? Oy? 
This is equation is of elliptic type. 

2. One-dimensional heat flow equation 


0 


Ou , Ou 
Ot Ox 
This equation is of parabolic type. 
3. One-dimensional wave equation 
ot? ex? 
This is a hyperbolic equation. 


9.6 HOMOGENEOUS AND NON-HOMOGENEOUS 
EQUATIONS WITH CONSTANT 
COEFFICIENTS 


Homogeneous Linear Equations with Constant Coefficients 


Let AD, D')z = V(x, y) (9.39) 
Thenif 
f(D,D')= A,D" + AD"!D'« AJD"?D! +--+ A,D'" (9.40) 
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where A,,A,,--:,A, are constants. ua ons 


Then Equation (9.39) is known as Homogeneous equation and takes the 
form 
(A,D" & A,D'"D'- A,D"?D" 4. A,D'"k- V(x, y) (9.41) DOLES 


Complementary Function 


Consider the equation, 
(A,D" 4 A,D'"D'& A,D"?D" e A,D" -0 (9.42) 
Let 

z - d(y4- mx) (9.43) 


be a solution of Equation (9.42) 
Now D'z- m'o'(y + mx ) 
D'zz oC (y 4 mx) 
and D'D^z- m'Q (y mx) 
Therefore, on substituting Equation (9.43) in Equation (9.42), we get 
(A m" +A m"? + Am"? +--+ A, (y+ mx)- 0 
which will be satisfied if 
A,m"+A,m"'+A,m"7*4+--+A, =0 (9.44) 
Equation (9.44) is known as the Auxiliary Equation. 
Let m,,m,,---,m,, be the roots of the Equation (9.44), 
Then the following three cases arise: 
Case I: Roots m,,m,,---,m, are distinct. 
Part of C.F. corresponding to m — m, is 
Z=0, (y +m x) 
where “,’ is an arbitrary function. 
Part of C.F. corresponding to m — m, is 
z=, (y + m,x) 
where , is any arbitrary function. 
Now since our equation is linear, so the sum of solutions is also a solution. 


Therefore, our complimentary function becomes, 


C.F. = 00 +m x) +, + MAX) senes +O (y+ mx) 
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Partial Differential Case II: Roots are imaginary. 


iiid Let the pair of complex roots of the Equation (9.44) be 
u X iv 
NOTES then the corresponding part of complimentary function is 
z = 0 + ux + ivx) + Oy + ux — ivx) ...(9.45) 


Let y + ux = P and vx = Q 
Then z= 0 (P + iQ) + (P- iQ) 
Or z= (6,* 6,)P + (6,- 6iO 


If 0,7 6, =, 
Andò- 6, = E 
Then 


" -= 6, +i€,) 


and 
" -6 ~ié,) 


Substituting these values in Equation (9.45), we get 


2-6 IQ) ie (iQ) e L8 iQ) NT iQ) 


2 
or 
z= GU iQ) +8(P-10)} HC +10) -E,(P-i9)} 


Case III: Roots are repeated. 
Let m be the repeated root of Equation (9.44). 
Then we have, 
(D—mD'\(D—mD'z=0 
Putting (D —mD^)z = U, we get (9.46) 
(D —- mD^U -0 (9.47) 
Since the equation is linear, it has the following subsidiary equations, 
dx dy | dU 
l = m H 0 
Two independent integrals of Equation (9.48) are 


(9.48) 


y +mx =constant 
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and U= constant Partial Differential 
Equations 


U= oly + mx) 
is a solution of Equation (9.47) where 6 is an arbitrary function. 


Substituting in Equation (9.46) NOTES 
Oz Oz 
mca rg m — 
Ox Oy 


which has the following subsidiary equations, 


= >(y+mx) (9.49) 


dx dy dz 


D c (y + mx) 
Two independent integrals of Equation (9.46) are 
y+mx =constant 


and z — xo(y+mx)+ constant 


Therefore | z—-x4(y ^ mx)-- w(y 4 mx) (9.50) 
is a solution of Equation (9.49) where is an arbitrary function. 


Equation (9.50) is the part of C.F. corresponding to two times repeated 
root. 


In general, ifthe root m is repeated r times, the corresponding part of C.F. 


z-x'" o (y «mx)ex "o, (y mx)e- 6 (y mx) 
where 6,,6,, ---, , are arbitrary functions. 


Example 25: Solve the equation, (p? —3D’D'+3DD” spo =0. 
Solution: The A.E. ofthe given equation is 
m! -3m/? +3m-1=0 
or (m-1) =0 
=> m=1,1,1 
C.F. = x7, (y+x)+xo,(y+x)+6,(y+x). 


Non-Homogeneous Linear Equations with Constant Coefficients 


Ifall the terms on left hand side of Equation (9.39) are not of same degree then 
Equation (9.39) is said to be Non-Homogeneous equation. Equation is said to 


be reducible if the symbolic function f (D, D’) can be resolved into factors each 
of which is of first degree in D and D' and irreducible otherwise. 
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Partial Differential For example, the equation 
Equations 


f(D,D' - (D? -D"? «2D «1 - (D- D'«1(D- D'«-1z =x? +xy 


is reducible while the equation 
NOTES 
f(D,D^ =(DD'+ D” - D'(D+ D?  - cos(x + 2y) 


is irreducible. 
Reducible Non Homogeneous Equations 
In the equation, 
f(D, D')=(a,D+b,D' +c, (a,D+b,D’+c,)---(a,D+b,D'+c,) ...(9.51) 
where a’s, b’s and c’s are constants. 
The complementary function takes the form 
(a,D+b,D' +c, (a,D+b,D' +c, )---(a,D+b,D' +c, )z - 0 (9.52) 
Any solution of the equation given by 
(a,D+b,D' +c, )z=0 (9.53) 
is a solution of the Equation (9.52) 
Forming the Lagrange’s subsidiary equations of Equation (9.53), 
dx z dy = dz 


a; b cz 


1 1 


(9.54) 


The two independent integrals of Equation (9.54) are 
b,x —a,y =constant 
Cj 
——x 
and z-constant e ^ , ifa. z 0 
or 


S 


y 
z-constante ^ , ifb, #0 


Therefore 


z= rs $;(b;x —a;y). if a, #0 


or 
T 
Z= e * w(bx—a,y) ifb, #0 


is the general solution of Equation (9.53). Here @, and w,are arbitrary functions. 
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Example 26: Solve the differential equations Partial Differential 
Equations 


(D? - p? -3D «3D'k - 0. 
Solution: The equation can also be written as 
(D-D'(D-«D'-3)2-0 
C.F. = oy + x)+ e^, (x = y) 
Or 


NOTES 


Wily +x) + e"y,(x - y) 
When the Factors are Repeated 


Let the factor is repeated two times and 1s given by, 


(aD + bD'+c) 
Consider the equation 
(aD+bD'+c\aD+bD'+c)z =0 (9.55) 
Put (aD+bD'+c)z=U (9.56) 
Then the Equation (9.51) reduces to 
(aD+bD'+c)U=0 (9.57) 
General solution of Equation (9.57) is 
U= 4,5 o(bx—ay) ifa 0 (9.58) 
Or 
U =e! W(bx—ay) if b #0 (9.59) 


Substituting Equation (9.58) in Equation (9.56), we obtain 


(aD +bD'te)z =e" (bx—ay) (9.60) 


The subsidiary equations are, 


dx dy _ dz 
D des vhs 9.61 
í e ° (bx —ay)—cz ven) 
The two independent integrals of Equation (9.61) are given by 
bx — ay = constant = À (9.62) 
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Equations d ] -&x ] -& 
: and CT z--e “ p(bx—ay)=—e * qQ(À) (9.63) 
dx a a a 
The Equation (9.63) being an ordinary linear equation has the following 
NOTES solution: 
e 1 
ze^ — —xq(A) * constant 
a 
Ly 1 
or ze’ =—x@(bx — ay) constant 
a 


Therefore, general solution of Equation (9.60) is 

Z= fe © (bx —ay)+,(bx - aye © 

a 

= ee (xo; (bx — ay) + p, (bx -ay )} sa pm) 
where 6, and Q, are arbitrary functions. 
Similarly from Equations (9.59) and (9.56), we get 

z=e * iyw (bx -ay)* y, (bx —ay)} 

where y, and y, are arbitrary functions. 


In general, for r times repeated factor, (aD-- bD' +c) 


z-e * Xx" (bx -ay) ifaz0 


where 9,,9, .....9, and W,,W>,....W, are arbitrary functions. 
Example 27: Solve the differential equation, 
(2D - D'« 4D -2D' «1?z - 0) 
Solution: C.F. corresponding to the factor (2D —D'+ 4) is 
e*¥ (x + 2y) 


C.F. corresponding to the factor (D = 2D'+1)’ is 
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e" ix, (2x = y)+ (2x y) 
Hence C.f. = e%(x +2y)+e™ {x, (2x - y)- €,0x - y)] 


Irreducible Non-Homogeneous Equations 


For solving the equation 
f(D,D’)z=0 (9.65) 
Substitute z = ce***y where a, b and c are constants (9.66) 


Now D'z=ca'e™* 
D'D"z=ca'b*e™* 
and D’*z =cb‘e™*” 
Substituting Equation (9.66) in Equation (9.65), we get, 
cf(a,b)e**» =0 
which will hold if 
f(a, b) =0 (9.67) 


For any selected value of a (or b) Equation (9.67) gives one or more values 


of b (or a). Thus there exists infinitely many pairs of numbers (a, b) satisfying 
Equation (9.67). 


Thus 

gc ge (9.68) 

i=l 
where f (a, „b; ) =0 y i isa solution of the Equation (9.65), 
If 
f(D,D')=(D+hD’+k)g(D,D’) (9.69) 

then any pair (a, b) such that 

at+hb+k=0 (9.70) 


satisfies Equation (9.67). There are infinite number of such solutions. 
From Equation (9.70) 


a — -(hb-- k) 
Thus 


oo 
z= Mopot 


1 


Partial Differential 
Equations 


NOTES 
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Partial Differential 
Equations -kx b; (y-hx ) 


=e cje ' (9.71) 
i=l 
is a part of C.F. corresponding to a linear factor (D +hD'+ k) given in 
NOTES Equation (9.69). 
Equation (9.71) is equivalent to 
e oly —hx ) 


where *ó' is an arbitrary function. 


Equation (9.68) is the general solution if f(D, D') has no linear factor 


otherwise general solution will be composed of both arbitrary functions and partly 
arbitrary constants. 


Example 28: Solve the differential equation (2p* +3D7D'+ D" =0. 


Solution: The given equation is equivalent to 
(2D? + D'\D? « D'k- o 


C.F. corresponding to the first factor 
= Y ce 


where a, and b, are related by 


a;x+biy 


2a? +b, =0 
or b. —-2a? 


Therefore, part of C.F. corresponding to the first factor 


e; (x-ej;y) 
Sae 


where e, and d, are arbitrary constants. 


Il 
UN 


C.F. = Y cesta) + Y dese) 


i=l i=l 


Particular Integral 
In the equation, 
f(D,D')z = V(x, y) ...(9.72) 
JD, D’) is anon homogeneous function of D and p’. 
1 
PL = rp, E) (9.73) 
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; ; Partial Differential 
b (el c , i 
Here if V(x, y) is of the form e^» where ‘a’ and ‘b’ are constants then Fauations 


we use the following theorem to evaluate the particular integral: 


Theorem 9.1: If f(a,b) #0, then 
NOTES 


(DD) tew) 
Proof: By differentiation 

D'De** =a’ ber 

D'e** agree 

Dg = piget 


f(D, De®” = fla, bje™” 


1 
ax+by __ f b ax+by 
à a, py 


Dividing the above equation by f(a, b) 


l ax+by 1 ax+by 
f(a,b) fOD) 
I ax+by = l ax+by 
° f(D,D') f(a,b) 


Example 29: Solve the equation (p? -D"-3D« 3D'k Sg 
Solution: The given equation is equivalent to 
(D-D'(QD4D'-3z-e*? 
C.F. = bly + x)+ ebay = x) 


1 x-2y 


 (D- D'XD* D'-3) 


P.I 


x-2y 


3 1 
Therefore, z = Qr x)re Qu) e 


But in case V(x, y) is of the form e**"'$(x, y) where ‘a’ and ‘b’ are 
constants then following theorem is used to evaluate the particular integral: 
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Botations Theorem 9.2: If (x, y) is any function, then 
l ax+by = ax+by l 
D,D) $(x. y) e Drs D oo) e») 
NOTES 


Proof: From Leibnitz's theorem for successive differentiation, we have 


D' fe" (x, y)j- e" ID'é(x. y) caD, y)j 


+ ca? d" $(x, y)+ c,a'o(x. y) 
= eaxtby ip gi UD zr esa Di sa videt c'a' (x. y) 


= ety (D +a) ọ(x,y)- 
Similarly 


D^ le^" p(x, y)}= et (D'+b)° qx, y) 


and D'D" fe™t g(x, y)}= D'[e"*" (D'&b)es, y)] 


= e™ (D +a) (D'«bJ(x.y) 
So f(D,D')ie**9(x, y)}= e™tf(D+a,D'+b(x,y) (9.74) 
Put f(D+a,D'+blx, y)=y(x,y) 


1 
o(x,y)= Dra Da) t?) 


Substituting in Equation (9.74), we get 


] 
f D D' ax+by = ax+by 
( , je mre) e v(x.y) 


1 
Operating on the equation by £(D,D’) 


ax+by 1 


“t(D +a,D'+ sje») “D,D p= "w(x.y)) 


Replacing y(x, y) by ọ(x,y), we have 


l ax+by — ,axtby l 
"pt o(x,y))=e Dai) e) 
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Example 30: Solve (D? - D”? -3D+3D’k = xv e". uis een 
Solution: The given equation is equivalent to, 
(D- D'(D^«D'-3)y2 xy«e*? 
C.F. = oly + x)+ eh, (x 25 y) 


1 1 
d (D-D'Jp«Dp'-3)" * (p-p'(p«D'-3) 


IE 
3 y 


x+2y 1 


1 
(D+1—D’—2)(D+1+D'+2-3) ` 


! 12 ! 
scs pub pe Te fi, 222 EDD! cc ye 
3D D D 3 9 


NOTES 


x42y 


P.I. 


| 

| 
U 
5|- 
a 

| 
og 


— —— 
(D-D'-1(D4D') 


Example 31: Solve (p? - DD'+D'-1)z =cos(x+2y)+e? +xy41. 
Solution: Equation is equivalent to 
(D — ID = D'+1)z = cos(x + 2y)+ e” +xy+l 
Complementary Function — e* Q,( y) - e" o, (x y). 


Particular integral corresponding to cos (x + 2y) is 
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Equations 2 
D? opc t y) 
1 
NOTES = (GDE C2 B cos(x + 2y) 


= seo t 2y) 


= ssin(x + 2y) 


Corresponding to e” | the particular integral is 


1 
= 2 ! ! e 
D'-DD'«D'-1 


y 


Particular Integral corresponding to the part (xy + 1) is 


1 
(D-1XD-D'+1 


yey) 


—{1-D}" 14+ (D-D')}" (xy +1) 

JD #D? Fa MDD ODY — Kays) 
=-1+D+D?+.....N(xy+1)-(y—x)-2} 
=-{1+D+D?+ m (xy y+x-l) 
=-{(xy-y+x-1)+(y+1) 

=-(xy+x) 


=-x(y+1) 


l. : 
Z SEE OEE sin On ota" -x(y+1) 
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Partial Differential 


9.7 PARTIAL DIFFERENTIAL EQUATIONS Equations 
REDUCIBLE TO EQUATIONS WITH 


CONSTANT COEFFICIENTS 
NOTES 


The equation, 
£(xD, yD')z = V(x. y) 
where f(xD, yD’) = Y'c, x' y'D'D",c,, = constant. (9.75) 


is reduced to linear partial differential equation with constant coefficients by 
the following substitution: 


u= log x, v=logy (9.76) 
By substitution of Equation (9.76) 
Q 


xD = x — 


Ox 
a au 


Qu ox 


= d(d - 1) 


Hence f(xD, yD’) - Y'c,d(d - 1) Ds la- r- r-1)a'(a- 1).....(d'—s -1) 


= g(d.d') 
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quations 


Thus by substitution Equation (9.75) is reduced to 
g(d,d')z = v(e" ; e“) 
Or g(d,d')z = U(u, v) (9.77) 


Equation (9.77) can be solved by methods that have been described for 
solving partial differential equations with constant coefficients. 


NOTES 


Example 32: Solve the differential equation, 
(xD? —4xyDD' +4y° D” + 6yD' =x°yí 
Solution: Put u = log x 


v=logy 
The given equation can be reduced to 


Íd(d —1)— 4dd' + 4d'(d' —1)+ 6d'}z = e?" 


OF ((a-2a*? - (a- 2a) =e" 

or (d-2d'(d-24' -1z = e" 

The complementary function is $, (2u + v)-- e"$, (2u +v) 
= $,(logx?y)+xd,(logx’y) 
= w,(x?y)+xw,(x*y) 


1 3u42v 


And the particular integral is ( d-2 dy d—2d'— 1) 


LN 


z=w,(x?y)+xy,(x’y}+ sty" l 


Example 33: Find the solution of, (xD? -y°D" -yD'« xD) =0 
Solution: Put u=logx 
v=logy 
The given differential can be reduced to 
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Ía(d -1)- a'(d' 21)-d'- diz 2 0 


Equations 
= (a? -a° } =0 
A.E. is NOTES 
m?-120 
> m=1,-1 
> z= ,(v+u)+6,(v—u) 
=  (logxy)+ (toe | 


= (y)+¥,(2). 


x 
Example 34: Determine the solution of the following equation: 
(xD? +2xyDD'+ y?D" )z +nz =n(xD+yD')z+x? +y +x? 
Solution: Put u=logx 
v=logy 
The Equation reduces to 
{d(d —1)+2dd’ - d'(d' — 1)]z ^ n(d - d')z nz 2 e? +e" +e" 
or 
((a--a)^- (4-- d) -n(d--d'z-e nz 2 e? +e” +e™ 


or 


{(d+d'Yd+d'-1)-n(d+d')+n}z=e™ ee? +e™ 
or 
(a +d’) —(n+1)(d+d')+ nk =e" +e” +e™ 
or 
(d-- d'- n(d--d'-1)z2 e? «e? «e^ 
C.F. = e™o,(u—v)+e"o,(u—v) 


ä X X 
y y 
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Equations PL- l fe 
= (d+d'-n\d+d'-1) 


2u +e” £e 


NOTES 


xy" 1 1 x 
n-2- 2-3 


2 2 3 
e Z-x'y = +xy DN eee 
i i y ! y n-2  2n-3 


, , , 1 
Example 35: Solve (D? -xyDD'-2y°D” +xD - 2yD k- log?-- 


Solution: Put u-logx 


v=logy 
Our equation reduces to 


(d(d — 1) dd' — 2a'(d' -1) +. d—-24'}z = v-u-l 
(a? dd! -24b =v-u-Ż 
or (a-24' Jd «d'e- v-u- 7 
C.F. = $((2u- v) 6,(u- v) 
= wibes}ew[ 


1 


PL. = (a—20'Xa+ AY = J 


Ki. a d’ 1 
= c Lett ens 
d - 2d' i d y z) 
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I 2 I Equations 
= v-u -—u 


! 12 
: yee! Paci Te [ww - zu] NOTES 
d d d 2 
Jon d 
= —4uv-u'-—u-cu 
d 
E 
2 4 
= 1 (ogxy beya oe] 
2 4 


1 1 
Z=W, (x?y)+ «(E + zex) logy ~ 7 (logxy 


Example 36: Solve the differential equation, 


(xD? +2xyDD' + y D^ b = (x? aie y) 


Solution: Put 


u=logx 


v=logy 


The equation is reduced to {d(d—1)+2dd' + d'(d' —1)}z = (e te” y 


or 


or 


CF: 


Particular Integral is = ( 


(a ed) -(d+ d'k E (e Le E 
(d + d'Xd -d'- lz -" (e? Le? } 


=ġþ(u-v)+e"ġ, (u-v) 


d+d'{d+d' -1 


n 
ye $ e?" y 
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Equations m 1 ds 2i 

titut Z= — |e" +e” }2 

Substituting umi ) 
Z z 
NOTES or A EL preteen) 

Ou Ov 
pn du dv dZ 
The subsidiary equations are pr 


Two independent integrals of Equation are given by 
u — v = constant = a (say) 
dZ 


T Z= (e te? 


and 
= nv, 2a 3 
e" (e +1) 
Since this equation is linear, therefore 


(n-1)v n 


Ze" = ane +1)2 
Min y 
eal (e? +1) 


2 Ae + feras 
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NOTES 


enean 


, , ' 8 
Example 37: Solve (ap? -2xyDD' + y*D” -xD +3yD k = = 


Solution: Put u=logx 
v=logx 
Our Equation reduces to 


{d{d—1)—2dd‘+ d'(d' - 1)- d-- 3d']z = Be"™™ 
o — ka-a% -2(a- a) = 8e"? 


or  (d-d'(d-d'-2)z28e*" 
C.F. = $ (u v) e? 9, (u-- v) 


= wi (xy)+x*w,(xy) 


8 : ery 
P.I. = ‘(d—d'\d—d’—2) 
—| e" 
-Y 
X 


< 


z=w(xy)+x°w,(xy)+ 


x . 


Example 38: Solve (xD? +2xyDD'+ yD" k zr d 


Solution: Put u-logx 
v=logy 
The equation reduces to 
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po Lc fa(d —1)+ 2dd'+ d'(d' -l)z = gmunnv 


o — (acay- (aea) = emm 


NOTES 
or  (d«d'(d«d'-1 ze" 

C.F. = »,(u—v)+e"o,(u—v) 

X X 

e 

y y 
1 mu+nv 

PL. = 


(d+d’\(d+d'—1) 


1 ene 


(m+n)(m+n-1) 


1 m n 


B (m+n\m+n—1) í 


z= X jix Eds: l xw 
NS y v2 y (m+n\m+n-1) ae 


Check Your Progress 


5. Write the general linear differential equation with constant coefficients. 

6. What are the three types of second order partial differential equations? 

7. What is the complementary function of the equation 
(A D" 4 A,D'"D'- A,D"?D? +--+ AD" k - 0 ifthe roots are 
distinct? 

8. Whenisa non-homogeneous equation said to be reducible? 


9. Which mathematical function is used to reduce partial differential 
equations to equations with constant coefficients? 


9.8 ANSWERS TO ‘CHECK YOUR PROGRESS’ 


1. Thepartial differential equation Pp + Og = R, where P, Q, R are functions 
of x, y, z is called Lagrange’s linear differential equation. 


2. We have to make following assumptions: 


(a) The mass of the string for each unit length is constant (‘homogeneous 
string’). The string is perfectly elastic and does not offer any resistance 
to bending. 
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(b) The tension caused by stretching the string before fixing it at the ends Partial DA d 
is so large that the action ofthe gravitational force on the string can be e 
neglected. 


(c) The string performs small transverse motions in a vertical plane; that 
is, every particle ofthe string moves strictly vertically and so that the 
deflection and the slope at every point ofthe string always remain 
small in absolute value. 


NOTES 


, . nx 
3. Each u,(x,t)- (B, cos A, t+ B, *sinA,r)sin 7x represents a harmonic 


motion having the frequency À, / 2x = cn/2L cycles per unit time. This 
motion is called the nth normal mode ofthe string. 


4. Charpit's method is used to find the solution of most general partial differential 
equation of order one. 


5. The linear differential equation with constant coefficients are of the form, 


d"y ary d"?y dy 
+P +P. +... +P _—+Py= 
dx” 1 dx”! 2 dx"? n-l dx aN Q 
Where P., P,, ...., P are constants and Q is a function of x. 


6. The three types of equations are the elliptic type, the parabolic type and the 
hyperbolic type. 


7. Let m,, m,, ..., m, be the roots ofthe equation then C.F. = $,(y + m x) + 
QQE EMA) H. + (y +m x) where Q/'s are arbitrary functions. 


8. The equation AD, D^z = V(x, y) is said to be reducible if the symbolic 
function f(D, D") can be resolved into factors each of which is of first degree 
in D and D'. 


9. Logarithm function is used to reduce partial differential equations to equations 
with constant coefficients 


SUMMARY 


e Lagrange’s equation can be solved by forming auxiliary equations and then 
finding two independent solutions ofthe auxiliary equations. 


e Waveequation governs the motion ofa violin string. 


Charpit's method is used to find the solution of most general partial differential 

equation of order one. 

e The general solution of F(D)y = Q consists of two parts: 

o Thecomplementary function which is the complete primitive of the 
reduced equation and is of the form 
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NOTES 
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y=cy, t cy, +t ...tc y, containing n arbitrary constants. 
o The particular integral which is a solution of F(D)y = Q containing no 
arbitrary constant. 
e Second order partial differential equations can be classified as elliptic, 
parabolic or hyperbolic type. 
e If AD, D2)z = V(x, y) and 
f(D,D')= A,D" + AD"! D' + A,D"? D; +--+ A, D'" where 
A,,AÀ5,, A, are constants then the equation is known as 
homogeneous equation. 
e Theroots of homogeneous equation can be distinct, repeated or imaginary. 


e If all the terms on left hand side of Equation f(D, D')z = V(x, y) are not of 
same degree then equation is said to be non homogeneous equation. Equation 
is said to be reducible if the function f(D, D") can be resolved into factors 
each of which is of first degree in D and D'and irreducible otherwise. 


e The equation, f (xD, yD')z = V(x, y) where 


f(xD, yD')= > c,X y D'D^,c, = constant is reduced to linear partial 


differential equation with constant coefficients by the substitution, 
u = log x and v = log y 


9.10 KEY WORDS 


e Partial differential equation: Any equation which contains one or more 
partial derivatives is called a partial differential equation. 


e Fundamental mode: The first normal mode is referred as the fundamental 
mode. 


9.11 SELF ASSESSMENT QUESTIONS AND 


EXERCISES 


Short-Answer Questions 


1. Define partial differential equations with suitable examples. 

2. How will you identify the order of a partial differential equation? 

3. Which equations are termed as singular integral? 

4. How will you determine the degree ofthe partial differential equation? 


5. What is a spectrum? 


6. Define Wronskian of functions. Partial Differential 


Equations 
7. Give examples of parabolic, elliptic and hyperbolic type equations. 
8. What is the difference between homogeneous and non homogeneous 
differential equations? NOTES 


Long-Answer Questions 
1. Solvethefollowing differential equations: 
a. (3z -4y)p * (Ax -2z)q 2 2y - 3x 
b. x(z* - y )p* (x? -z)a = 2(y* - x") 
2. How does the frequency of the fundamental mode of the vibrating string 


depend on the (a) Length ofthe string (b) On the mass per unit length (c) 
On the tension? What happens to that frequency if we double the tension? 


3. Find u(x, f) of the string of length L = n when c?- 1, the initial velocity is 
zero, and the initial deflection is 


a. 0.01 sin 3x. 
: 1. 
b. isin x- 5 2] 


c. 0.1x(z = x). 
d. 0. 1x(z? =x? J 
4. Findthe deflection u(x, t) of the string of length L =n and ¢? = | for zero 
initial displacement and ‘triangular’ initial velocity u, (x,0) E (0.01x) if 
al iod T ; 
0«x« sr , u,(x,0) = 0.01(z — x) T «x <7. (Initial conditions with 


u, (x,0) + O are hard to realize experimentally). 
5. Find solutions u(x, y) ofthe following equations by separating variables. 
a u,+u, =0. 
b. u,-u,-0. 
c yu,-xu,-0 


d. utu, (x yu 
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Equations f Uy, —u-— 0 
g Ur. D Uy, = 0 
NOTES h  xu,-t*2yu-0 


6. Show that 


a. The substitution of u(x,t) = »3 G, (t)sin A (L -length ofthe string) 


n-l 


into the wave equation governing free vibrations leads to 


_ enu 


G, 4328 20, 4, = — 
L 


b. Forced vibrations ofthe string under an external force P(x, f) per unit 
length acting normal to the string are governed by the equation 


M" P 
Un =. Ux t—, 


P 
7. Find Complete Integrals ofthe following equations: 


a p’°+px+q=z. 
b. pixeq'y-z. 
c. pxeqyoz Jl pq. 
d. p(l*q)-q(z-a). 
e. pq * xQy «Up *(? - ya -Qy 12-0. 
£^ (paXpx-ay)-1. 
g  pxytpqtqy—-yz 
ho (p? +4? koe 
Lo Ay +2q)= aep + y), 
8. Solve the equations: 
a  (D'«Dp^-1D?^k-0. 
b. (D° +3D°D'-4D"k=0 
9. Solve the equations: 
& (D? +2DD’+D” -12xy. 
b. (p?-2Dp'-15D? k =12xy. 
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10. 


11. 


12. 


13. 


14. 


15. 


c- (p?-6DD'-9D? k - 12x? +16xy. dos 
4. (p!-7bDD"-6D?^k-2x!exy!-y. 
e. (p?»p'-2pp? «p^ k- DOLES 

As 


Solve the equations: 


a. (D^ -Dp'-2D?E-x-y. 


b. (D?-3DD’+2D? k=x+y, 
c. (4D? -4DD' +D”? y - 16log(x+2y). 


d. (p? -7DD” -6D^k -cos(x - y)- x? * xy? +y’. 
e. (D?-7DD" -6D" = sin (x +2y)+e* 


t (p-spp?«2D?^k-Jx-2y. 

& (D°-4D°D'+5DD? -2D" b =e" e yx 
Solve the equations: 

a. (p? -3DD" -2D^ - cos(x - 2y). 

b. (D'«sDD'«-5D"k- xsin(3x -2y). 

Solve the equations: 

a  (p^-Dd'-2D?k-(y-1e. 

b. (D?-3DD" -2D^ pk = cos(x + 2y)-e* (3+ 2x). 
Solve the equations: 

a  (DD'-D?-3D'k-0. 

b. (2D«D'-I)(D-2D'«2yz-0. 

Solve the equations: 

a QD-p"«Dpk-o 

b. (D?+DD'+D+D'+1)z2=0. 

Solve the equations: 

a. (D-D'-1(D«D'-2z-e77 


b. (p? -p'k = e" 
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Equations 


a. (p? - DD' -2Dk = cos(3x + 4y). 
NOTES b. (p? — D'i = Acos(Ix + my), where A, /, m are constants. 
17. Solve the equations: 
a (D=D'-1(D+2D'—3)z=4+3x+6y. 


x+2 


b (D'-Dp?-p?«pp'k- 


x? 
c. (D? -p')y -2y-x^. 
18. Solvethe equations: 
a. (DED? = cos(x —3y). 
b. (D«D'-I(D«D'-3(D-D'zse*" sin(2x +y). 
c. (D'«DD'«D'-Iz-4sinh x. 
d. (D?p' +D” -2k =?" sin3x - e? cos2y. 
19. Solvethe equations: 
à (x^D? -yD"b-xy. 
b. (xD? +2xyDD'+ yD? k- x^y^. 
c. (xD? —2xyDD' -3y^D" + xD-3yD' = x^ycos(logx? . 
20. Solve (D? -2D?D'- DD? +2D")z =e" 
21. Solve (D? +D" +D" -3DD'D'Ja = x? = 3xyz. 
22. Solvethe following equations: 
a r-xe. 
b. xys-l 
23. Solvethe following equations: 
a. t-xq--siny-xcosy. 
b. t-xq-x^ 
c yt-q-xy 
24. Solvethe following equations: 
a. xr+ys+p=10xy° 
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3 i 
b. 2yt —XS-c 2q = 4yx ; Equations 


c. z4r-xcos(x y). 


25. Solve the differential equation, r -2yp-- y'z (y 2) NOTES 
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UNIT 10 ORDINARY DIFFERENTIAL 
EQUATIONS 


Structure 
10.0 Introduction 
10.1 Objectives 
10.2. Ordinary Differential Equations 
10.3 Answers to Check Your Progress Questions 
10.4 Summary 
10.5 Key Words 
10.6 Self Assessment Questions and Exercises 
10.7 Further Readings 


10.0 INTRODUCTION 


In mathematics, an ordinary differential equation is a relation that contains functions 
of only one independent variable and one or more of their derivatives with respect 
to that variable. Ordinary differential equations are distinguished from partial 
differential equations, which involve partial derivatives of functions of several 
variables. Ordinary differential equations arise in many different contexts including 
geometry, mechanics, astronomy and population modelling. The Picard—Lindelóf 
theorem, Picard's existence theorem or Cauchy—Lipschitz theorem is an important 
theorem on existence and uniqueness of solutions to first-order equations with 
given initial conditions. The Picard method is a way of approximating solutions of 
ordinary differential equations. Originally, it was a way of proving the existence of 
solutions. 


In this unit, you will study about the ordinary differential equations and local 
truncation error. 


10.1 OBJECTIVES 


After going through this unit, you will be able to: 
e Understand the ordinary differential equations 


e Analyse the local truncation error 


10.2 ORDINARY DIFFERENTIAL EQUATIONS 


Even though there are many methods to find an analytical solution of ordinary 
differential equations, formany differential equations solutions in closed form cannot 
be obtained. There are many methods available for finding a numerical solution for 


differential equations. We consider the solution ofan initial value problem associated Ordinary ae ds iat 
. . . . . uations 
with a first order differential equation given by, g 


d 

Z- f(x,y) 
dx NOTES 
(10.1) 


With V(X) EV (10.2) 
In general, the solution of the differential equation may not always exist. For 


the existence ofa unique solution ofthe differential Equation (10.1), the following 
conditions, known as Lipshitz conditions must be satisfied, 


(Ò The function f(x, y) is defined and continuous in the strip 
R: xy, Sx&b, -o<y<oo 


(ii) There exists a constant L such that for any x in (x,, b) and any two num- 
bers y and y, 
Ix, y) — foc y)]«Llv = vl 
(10.3) 


The numerical solution of initial value problems consists of finding the ap- 
proximate numerical solution of y at successive steps x, x,,...,x, of x. A number 
of good methods are available for computing the numerical solution of differential 
equations. 


Picard's Method of Successive Approximations 


Consider the solution ofthe initial value problem, 


d ` 
es = f(x,y) with y(x,) — y, 


Taking y =y (x) as a function of x, we can integrate the differential equation 
with respect to x from x — x, to x, in the form 


y- Jo «re y(x)) dx (10.4) 

The integral contains the unknown function y (x) and it is not possible to 

integrate it directly. In Picard’s method, the first approximate solution y? (x)is 
obtained by replacing y (x) by y, 


Thus, y? (3) » yo + | AG »)dx (10.5) 


Xo 


The second approximate solution is derived on replacing y by y® (x). Thus, 


x 
2 1 
v(x) = yv [ros y" A) ax (10.6) 
Xo 
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Ordinary Differential The process can be continued, so that we have the general approximate solu- 


Equations tion given by, 


NOTES 


Xo 


O= yt [£6 » "Gs. for n =2,3... (10.7) 


This iteration formula is known as Picard's iteration for finding solution ofa 
first order differential equation, when an initial condition is given. The iterations are 
continued until two successive approximate solutions y and y“") give 
approximately the same result for the desired values of x up to a desired accuracy. 


Note: Dueto practical difficulties in evaluating the necessary integration, this method 
cannot be always used. However, if f(x, y) is a polynomial in x and y, the succes- 
sive approximate solutions will be obtained as a power series of x. 


Example 1: Find four successive approximate solutions for the following initial 


value problem: y'- x^ y, with y (0) — 1, by Picard’s method. Hence compute y 


(0.1) and y (0.2) correct to five significant digits. 
Solution: We have, y' 2 x * y, with y (0) 1. 


The first approximation by Picard's method is, 


yP (x) = (0) + [x+y Olax 
x 


y?) 21 [G0 dx=1+x+ T 
0 


The second approximation is, 


x 2 
y?) els [attri eet + 
0 


Similarly, the third approximation is, 


x 3 
y?Q) alt f 2x x* ll 
0 


3 4 
X 


OG)2lexx Ll 
dL QUT 


The fourth approximation is, 


x 3. 4 
Ox 21e [02x x! - 5 Tax 
on | 3*3 


4 5 
X X 


3 
OMsltxtx REL 42 
y Q-btetx +o t05 t) 


Itis clear that successive approximations are easily determined as power se- 
ries of x having one degree more than the previous one. The value of y (0.1) is 


given by, 
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2 (0.1)? (0. )* fund: : Equations 
y (0.1) =14+0.1+(0.1)° + BS + a +...*1.1103, correct to five significant dig- 
its. 
3 4 5 NOTES 
Similarly, y(0.2) 2 1-- 0.2 + (0.2) + ES Une Ey ce 


3 4 120 


Example 2: Find the successive approximate solution of the initial value problem, 
y! 2 xy +1, with y (0) = 1, by Picard's method. 


Solution: The first approximate solution is given by, 
x e 
y= 1+ (e+ Dae exem 
0 


The second and third approximate solutions are, 


x 2 2 3 4 
2) =1+] x(l+x+)4l]dx=l+x4¢2424"% 
P R ERE 


f x? x) x* x? x? xÍ x x$ 
yO (x)= 1 [xax +—+—)+]]dx =1+ x+—+—+—+—+ 
2 3 4 2 3 8 15 48 


0 


Example 3: Compute y (0.25) and y (0.5) correct to three decimal places by 
solving the following initial value problem by Picard's method: 


dy x? 
dx ]4 y 
dy x^ 
Solution: We have 7- = ;::(0)-0 
dx l+y 


By Picard’s method, the first approximation is, 


x 2 3 
9) - 0. [5 dint 
Mp eal 3 


The second approximate solution is, 


x 2 
(2) = x 
y^ (x) Jio m x 
x x? 
= f 7 dx = tan ! 
0 ee 
9 
(25) 
For x=0.25, y? (0.25) = TIL = 0.0052 
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2 
y? (025)- tan” CS) L 0.0052 


-. y (0.25) 2 0.005, Correct to three decimal place. 
NOTES 


0.5) 
Again, for x =0.5, y (0.5) = c = 0.083333 


4 (0.5)? 


y (0.5) = tan = 0.0416 


Thus, correct to three decimal places, y (0.5) ^ 0.042. 


Note: For this problem we observe that, the integral for getting the third and 
higher approximate solution is either difficult or impossible to evalute, since 


2 
X 


Of X ss, 
y c) | QV isnot integrable. 
me G ) 


Example 4: Use Picard’s method to find two successive approximate solutions 
ofthe initial value problem, 


d -x 
7 =2* y(0)-1 
dx yx 


Solution: The first approximate solution by Picard’s method is given by, 


VOA) =y + | SE y)dx 


rf l-x p 2-(1+x) 
(x) =14 | ——dx-214| —————dx 
ye) J l+x J l+x 
+ 2 


y? (x) =14 2log, |1 - x|-x 


The second approximate solution is given by, 


y? (x)= yot | fy coax 
0 


x 


Í x—-2x-*2log, |1+x| 


dx =1+x 2f E dx 
1+2log, |14 x | A 1+2log,|l+x| 


We observe that, it is not possible to obtain the integral for getting V(x). Thus 
Picard’s method is not applicable to get successive approximate solutions. 


Multistep Methods 


We have seen that for finding the solution at each step, the Taylor series method 
and Runge-Kutta methods requires evaluation of several derivatives. We shall 
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now develop the multistep method which require only one derivative evaluation Ordinary Differential 


per step; but unlike the self starting Taylor series or Runge-Kutta methods, the dod 
multistep methods make use ofthe solution at more than one previous step points. 
Letthe values of y and y! already have been evaluated by self-starting methods NOTES 


ata number of equally spaced points x,, x ,...., x. . We now integrate the differential 
equation, 


d 
Y = f(x, y), from x, tox, 
dx 

Les [a= | fe »)ax 


Yar = Int | fos YH) d 


To evaluate the integral on the right hand side, we consider f(x, y) as a function 
of x and replace it by an interpolating polynomial, i.e., a Newton's backward 


difference interpolation using the (m + 1) points x, x, |, X, ,,..., X, 
as -DECA f. ,, where s- 
Pm (x) >! ) G ) Sa-k W. 5 h 
» 1 
(z)e-sCs-DCs - 2)...(-s-k +1). a 
Substituting p, (x) in place of f (x, y), we obtain 
1 m 
Vint = Pa «n[Y cp (7) A s ds 
0 k-0 
= Xn F h DA + MGR i TAE Teck YN oui 
1 
Where. y, 2 (-D* (7) ds 
0 
The coefficients y, can be easily computed to give, 
MEUS CN QN 
Yo 7 4, i Yo 715 13 = 9 Ya = 9 9€ 


Taking m = 3, the above formula gives, 


1 53 $us 
=y, +h| f,+—Af,.+—A +—A 
Xn& —7 Yn Ç 2 YR 12 fua 8 fes 


Substituting the expression ofthe differences in terms of function values given 
by, 
Aca e futi ago fo- of efus 
Af us cx Sa -2f.4 X355 = fas 
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Ordinary Differential We get on arranging, 
Equations 


h 
Jua = Yn tu [55 f, fa +37 a9] (10.8) 


This is known as Adams-Bashforth formula of order 4. The local error of 


NOTE? this formula is, 


5 rivet s+3 
E=h'f ej i | ds (10.9) 


Byusing mean value theorem of integral calculus, 


s+3 
E= “rly Je 


Or, 25] (10.10) 


E- Ff 


The fourth order Adams-Bashforth formula requires four starting values, i.e., 
the derivaties, f, f, f, and fọ. This is a multistep method. 


Predictor-Correction Methods 


These methods use a pair of multistep numerical integration. The first is the Predictor 
formula, which is an open-type explicit formula derived by using, in the integral, an 
interpolation formula which interpolates at the points x , x... ,,..., X, „ The second 
is the Corrector formula which is obtained by using interpolation formula that 
interpolates at the points x |, x , ..., x „1n the integral. 


n+l aX n- 


Euler’s Predictor-Corrector Formula 


The simplest formula ofthe type is a pair of formula given by, 


X =y, +h fs, Vn) (10.11) 


c h 
A AI n+ S En IDS Gao (10.12) 


In order to determine the solution ofthe problem upto a desired accuracy, the 
corrector formula can be employed in an iterative manner as shown below: 


Step 1: ane y , using Equation (10.11) 


TI? 
i.e, y (0) = Vr hf(x,, y,) 
Step 2: Compute y using Equation (10.12) 


n+l 


1. e., EE Yn z LAX, yn) dept ass yE 1 for K = iB 2; 3,45 


The ee is continued till the condition given below is satisfied, 


(k) (k-1) 
Vas — Viel 
(k) 


<E 10.13 
Yni ( ) 
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where £ is the prescribed accuracy. Ordinary Differential 


It may be noted that the accuracy achieved will depend on step size / and on THE 
the local error. The local error in the predictor and corrector formula are, 
n n 
3479) and “age ATA respectively. NOTES 
Milne's Predictor-Corrector Formula 
A commonly used Predictor-Corrector system is the fourth order Milne s 
Predictor-Corrector formula. It uses the following as Predictor and Corrector. 
4h * 
yP =y, 4+ 3 fn fua +2 fy2) 
© h (») 10.14 
Vas = Vn taps + faa On Yna) ( 3 ) 
The local errors in these formulae are respectively, 
14 l 
IB (re and — — i? Oe 10.15 
45 y ($) 90 y" ($) ( ) 
; : d 
Example 5: Compute the Taylor series solution ofthe problem = =xy +1, y(0)=1, 
up to x? terms and hence compute values of y(0.1), y (0.2) and y (0.3). Use 
Milne's Predictor-Corrector method to compute y (0.4) and y (0.5). 
Solution: We have y'= xy «1, with y (0) — 1, ~. (0) 21 
Differentiating successively, we get 
y'Q)- xy * y Ay (0 =l 
y"(x) = xy" + y" ey -2 
x" Qaa" 43y' yO) -3 
yx) = xy? cay" yO) 28 
Thus the Taylor series solution is given by, 
2 3 4 5 
, x ” x m x iv x v 
V(x) = y(0) + xy (0) + — y” (0) + — »"(0) + — y” 0) - — y (0) 
2 3! 4! 5! 
x x xÍ x 
=l+x+—+—x2+—x3+—x8 
2 3! 4! 5! 
n y(x)=1+ E rs fea E 
Md LAM E REC T 
« y(0.1)=14+0.14 0.01 à 0.001 » 0.0001 " 0.00001 
2 3 8 15 
— 1.1053 
y(02)214024 0.04 E 0.008 s 0.0016 m 0.00032 
3 8 15 
= 1.22288 
(0.3) =1403+4 0.09 ip 0.027 à 0.0081 n 0.00243 
3 8 15 
= 1.35526 Self-Instructional 
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Ordinary Differential 


Equations For application of Milne's Predictor-Corrector method, we compute y’ (0.1), 


»' (0.2) and y’ (0.3). 


y'(0.1) 20.1x1.1053 4-12 1.11053 
y'(0.2) = 0.2x1.22288 + 1 = 1.244576 
y'(0.3) = 0.3 x 1.35526 +1=1.40658 


NOTES 


; : 4h 
The Predictor formula gives, y, — y(0.4) = y,* 3 Qi - +294). 


IE wee (2 x1.11053 — 1.24458 + 2 x 1.40658) 


= 1.50528 ^y, =14+0.4x« 1.50528 21.602112 
. h , £ , 
The Corrector formula gives, yP =y, +302 +4y,+y4), 


y(0.4) = 1.22288 + ~ (1.24458 + 4 x1.40658 + 1.60211) 


= 1.22288 + 0.28243 
=1.50531 


Numerical Solution of Boundary Value Problems 


We consider the solution of ordinary differential equation of order 2 or more, 
when value of the dependent variable is given at more than one point, usually at the 
two ends of an interval in which the solution is required. For example, the simplest 
boundary value problem associated with a second order differential equation is, 
y" tp (x) y tq Oy =r (x) (10.16) 
with boundary conditions, y (a) =A, y (b) - B. (10.17) 
The following two methods reduce the boundary value problem into initial 
value problems which are then solved by any of the methods for solving such 
problems. 
Reduction to a Pair of Initial Value Problem 


This method is applicable to linear differential equations only. In this method, the 
solution is assumed to be a linear combination of two solutions in the form, 


V(x) = u(x) +% (x) (10.18) 


where À is a suitable constant determined by using the boundary condition and 
u(x) and v(x) are the solutions ofthe following two initial value problems: 


G)  uw'tpOo)u' + q(x)u = r(x) 


u(a) = A, u' (a) = œ, (say). (10.19) 
(i) V” +p) v' + q(x)o =r) 
v (a) ^ 0 and v'(a) = o, , (say) (10.20) 
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where ot, and ot, are arbitrarily assumed constants. After solving the two initial 
value problems, the constant À is determined by satisfying the boundary condition 
at x = b. Thus, 


B=u(b)+Xv (b) 


On A= Bee) , provided v (b) #0 (10.21) 
v (b) 


Evidently, y(a) = A, is already satisfied. 


If v(b) = 0, then we solve the initial value problem for v again by choosing 
v(a) = 0t, for some other value for which v(5) will be non-zero. 


Another method which is commonly used for solving boundary problems is 
the finite difference method discussed below. 
Finite Difference Method 


In this method of solving boundary value problem, the derivatives appearing in the 
differential equation and boundary conditions, if necessary, are replaced by 
appropriate difference gradients. 


Consider the differential equation, y" +p(x) y' + q(x)y 7 r(x) (10.22) 


with the boundary conditions, y (a) = o and y (5) ^ B (10.23) 
The interval [a, 5] is divided into N equal parts each of width h, so that 
h — (b-ay/N, and the end points are x, =a and x, = b. The interior mesh points x, 
at which solution values y(x) are to be determined are, 
Aoc rU n, 2 ss NI 
(10.24) 
The values of y at the mesh points is denoted by y, given by, 
y, oy nh), n=0, 1, 2, ..., N (10.25) 
The following central difference approximations are usually used in finite 
difference method of solving boundary value problem, 


ya) s Tet en (10.26) 
—2y + 
popen (10.27) 


Substituting these in the differential equation, we have 
2(y 72v, Yat) + p, hir y.) + 2 gy, = 2n h, 
where p, — px), q, = q(x ), r, — r(x,) (10.28) 
Rewriting the equation by regrouping we get, 
(2-Ap y, |t C4*2/?q )y HA y, = 2r h 
(10.29) 


Ordinary Differential 
Equations 


NOTES 
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Ordinary Differential This equation is to be considered at each of the interior points, i.e., it is true for 
Equations 
n=1,2,..., N-1. 


The boundary conditions ofthe problem are given by, 


NOTES y -9 y,-p 
(10.30) 


Introducing these conditions in the relevant equations and arranging them, we 
have the following system of linear equations in (N-1) unknowns y,, y,, ... y, ,. 


(74 2h^q))y, +(2+hp,)y, = 27h? - (2- hp,)a 
(2—hp,)y, +(-442h'q,)y, +(2+hp,)y; -2nh 
(2—hp,)y, + (4 2f! qj)y, +(2+hp;)y, = 2r h? 


(2-hpy-2)+ (4+ 2h G5) es (2+Apy_y) ya = rh 


Q-Apy a) yy t (4420 Gy) Ya = Wal? -Q — hp, )B (10.31) 
The above system of N-1 equations can be expressed in matrix notation in the 
form 
Ay=b 
(10.32) 


Where the coefficient matrix A is a tridiagonal one, of the form 


[B y 0 0. 0 0 0 
Ay B, Gy. Uus 0 0 
0 A, B, Cj... 0 0 0 
di M E. (10.33) 
0 0 0 Ay» By» Cy 3 
| 0 0 0 Ü- Aya he 
Where B, =-4+2h°q,, i=1,2,.,.N-1 
C,=2+hp, | i-L2,,N-2 (10.34) 
4 -2-h,  i-2,3.,N-1 
The vector b has components, 
b, = 2y,h° - 2 — hp,)a. 
(10.35) 


b, = 2y,h’ ,fori22,3,., N -2 
by, = 2Yyat k - (25 hip, ,)p 


The system of linear equations can be directly solved using suitable methods. 
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Example 6: Compute values of y (1.1) and y (1.2) on solving the following initial 
value problem, using Runge-Kutta method of order 4: 
y' «7 y-0, with (1) = 0.77, y' (1) --0.44 


Solution: We first rewrite the initial value problem in the form of pair of first order 
equations. 


with y (1) = 0.77 and z (1) = —0.44. 
We now employ Runge-Kutta method of order 4 with A — 0.1, 


y(1.1) = y(D4 ; (k, + 2k, + 2k, + ky) 


yl.) 2 z1.1) 214 La 2L, +24 +L) 


k, = —0.44 x 0.1 = —0.044 


i, =0.1x = = om) = -0.033 


k, 2 0.1x| -0.44 — HS = 0.04565 
1, =0.1x eae 0.748 | = —0.031323809 
1.05 
k, =0.1x| -0.444 mmm = —0.0455661904 
L =0.1x | 00455661904 - 0.747175] = —0.031321128 


k, =0.1x (—0.47132112) = -0.047132112 


0.047132112 
1.1 


1, =0.1x 0.72443381 |= -0.068158643 


~ y(1.1) 2 0.774 A 0.044 + 2 x (-0.045661904) — 0.029596005] = 0.727328602 


1 
y'(1.1) = —0.44 [70.033 + 2(—0.03 1323809) + 2(—0.03 1321128) — 0.029596005] 


6 


= —0.44 =| 0.33 — 0.062647618 — 0.062642256 — 0.029596005] 


= —0.526322021 


Example 7: Compute the solution of the following initial value problem for x — 
0.2, using Taylor series solution method of order 4: n.1. 
PY pd 


de FE X0) =1, y'(0) 20 


Ordinary Differential 
Equations 


NOTES 
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Equations 


NOTES 
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Solution: Given y" = y+ xy’, we put z = y’, so that 
z’=yt+xz, y’=zand y(0) =1, z(0) =0. 
We solve for y and z by Taylor series method of order 4. For this we first 
compute y'(0), y"(0), y^ (0),... 
We have,  y"(0)=y(0)+0xy'(0)=1, z'(0)-1 
y" (0) = z'(0) = y'(0) + z(0) + 0.2(0) 20 
y" (0) = z"(0) = y"(0) + 2z'(0) +0.2"(0) 23 
z” (0) 2 4z"(0) + 0.z"(0) =0 
By Taylor series of order 4, we have 


2 3 4 
90-2) = »(0) (0) 7 0) 7 y") 7 ^ (0) 


x x! 
Or, Pal ane 

2 4 
(0.2) » (0.2) 


23(02)-1«— 


=1.0202 


(0.2)? 
4! 
Example 8: Compute the solution of the following initial value problem for x = 


Similarly, y’(0.2) = z(0.2) = 0.2 + x3 = 0.204 


d'y 
dx? 
Solution: Given y" = xy, we put y'= z and the simultaneous first order problem, 


0.2 by fourth order Runge -Kutta method: n.1. = xy, y(0)=1, y(0) 21 


y'2z- f(x, y, Z), say z' = xy = g(x, y, z), say with y(0) =1 and z(0) z1 
We use Runge-Kutta 4th order formulae, with A = 0.2, to compute y (0.2) 
and »'(0.2), given below. 
k =h f(X ys z)202x1202 
l-hg(x, Yə z)20.22x0z20 
k 


h l 
oh (s. Vo + 3 4*1 )=0.2%+0)=02 


h l 0.2 0.2 
L=h +—, yt—, z+2/=0.2x— (1+) = 0.022 
2 ss 2 Xo Zo 3 2 2 


k L 
Ya +52) + 5 )-02x1.011=0.2022 


2? 2 
h k 
h=hel se. ts a +2} =02x0.1x1.1=0.022 


ky =h f(x *h, yy, z +4) =0.2%1.022 = 0.2044 
l,2h g(x +h, yy*k, 2 +4) =0.2 x 0.2 x1.2022 = 0.048088 


y(0.2) =1+ E (0.2 + 2(0.2 + 0.2022) + 0.2044) — 1.2015 


y’(0.2) =1+ E (0--2 (0.022 0.022) + 0.048088) —1.02268 


Local Truncation Error Ordinary Differential 
Equations 


Local Truncation error in a numerical method is error that is caused by using 

simple approximations to represent exact mathematical formulas. The only way to 

completely avoid truncation error is to use exact calculations. However, truncation NOTES 
error can be reduced by applying the same approximation to a larger number of 

smaller intervals or by switching to a better approximation. Analysis oftruncation 

error is the single most important source of information about the theoretical 

characteristics that distinguish better methods from poorer ones. With a 

combination of theoretical analysis and numerical experiments, it is possible to 

estimate truncation error accurately. 


Check Your Progress 
. Define Picard's method of successive approximation. 
. What is a predictor formula? 


. Whatare local errors in Milne's predictor-corrector formulae? 


BW N — 


. Wherecan the method of reduction to a pair of initial value problem be 
applied? 


10.3 ANSWERS TO CHECK YOUR PROGRESS 
QUESTIONS 


1. In Picard's method the first approximate solution y»” (x)is obtained by 


replacing y(x) by y, Thus, y(x)=y, +f fear de. The second 


Xo 


approximate solution is derived on replacing y by y(1) (x). Thus, 


9G) yt [fy (y dx. 


Xo 


This iteration formula is known as Picard's iteration for finding solution ofa 
first order differential equation, when an initial condition is given. The iterations 
are continued until two successive approximate solutions y* and y^* ! give 
approximately the same result for the desired values of x up to a desired 
accuracy. 


2. A predictor formula is an open-type explicit formula derived by using, in the 
integral, an interpolation formula which interpolates at the points x , x. 
sog 


1? 


n-m 
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Ordinary Differential 14 1 
Equations 3. The local errors in these formulae are Js I? y? (é) and - Em Wy): 


4. This method is applicable to linear differential equations only. 
NOTES 
10.4 SUMMARY 


e Picard’s iteration is a method of finding solutions ofa first order differential 
equation when an initial condition is given. 


e The multistep method requires only one derivative evaluation per step; but 
unlike the self starting Taylor series on Runge-Kutta methods, the multistep 
methods make use of the solution at more than one previous step points. 


* These methods use a pair of multistep numerical integration. The first is the 
predictor formula, which is an open-type explicit formula derived by using, 
in the integral, an interpolation formula which interpolates at the points 

X,X, X, ,, The second is the corrector formula which is obtained by 

using interpolation formula that interpolates at the points x, | X, ..., X, Es in 

the integral. 


e The solution of ordinary differential equation of order 2 or more, when 
values ofthe dependent variable is given at more than one point, usually at 
the two ends ofan interval in which the solution is required. 


e The methods used to reduce the boundary value problem into initial value 
problems are reduction to a pair of initial value problem and finite difference 
method. 


10.5 KEY WORDS 


e Predictor formula: It is an open-type explicit formula derived by using, in 
the integral, an interpolation formula which interpolates at the points x , 
x re 


n-1? °°? n-m 


e Corrector formula: It is obtained by using interpolation formula that 
interpolates at the points x, | |, x, ..., Xp in the integral. 


10.6 SELF ASSESSMENT QUESTIONS AND 
EXERCISES 


Short-Answer Questions 


1. What are ordinary differential equations? 
2. Name the methods for computing the numerical solution of differential 
equations. 
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3. When is multistep method used? 
4. Name the predictor-corrector methods. 
5. How will you find the numerical solution of boundary value problems? 


Long-Answer Questions 


1. Use Picard's method to compute values of y(0.1), (0.2) and y(0.3) correct 
to four decimal places, for the problem, y 2 x * y, y(0)7 I. 


2. Given 2 : x +x°)y?, and y(0) = 1, y(0.1) = 1.06, y(0.2) = 1.12, (0.3) 
= 1.21. Compute (0.4) by Milne's predictor-corrector method. 
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UNIT 11 EULER'S METHOD 


Structure 


11.0 Introduction 

11.1 Objectives 

11.2 Euler Method 

11.3 Answers to Check Your Progress Questions 
11.4 Summary 

11.5 Key Words 

11.6 Self Assessment Questions and Exercises 
11.7 Further Readings 


11.0 INTRODUCTION 


The Euler method is a first-order method, which means that the local error (error 
per step) is proportional to the square of the step size, and the global error (error 
at a given time) is proportional to the step size. The Euler method often serves as 
the basis to construct more complex methods. 


In this unit, you will study about the Euler’s method and modified Euler’s 
method. 


11.1 OBJECTIVES 


After going through this unit, you will be able to: 
e Analyse the Euler’s method 
e Understand about the modified Euler’s method 


11.2 EULER’S METHOD 


Euler's is a crude but simple method of solving a first order initial value problem: 


d 
Ao fy) Y(X) = yo 


This is derived by integrating f Œ» y,) instead of f(x, y) for a small interval, 


xo*h xod 
J w= | fev voix 
y +A) - V(X) = Af (3. ys) 
Writing y, =y (x,+ ^), we have 


YA Vth fl OS (11.1) 


Similarly, we can write Euler’s Method 


y,7 y Gt h) = yt hf y) (11.2) 
where x, — x,* A. 
Proceeding successively, we can get the solution at any x, =x,+nh, as NOTES 
X, = Mt hf x, Yaa) (11.3) 


This method, known as Euler’s method, can be geometrically interpreted, as 
shown in Figure 11.1. 
Y 


Fig. 11.1 Euler s Method 


For small step size A, the solution curve y = y (x), is approximated by the tan- 
gential line. 


The local error at any x, , i.e., the truncation error ofthe Euler's method is given 
by, 
€, VO) Vea 
Where y, , is the solution by Euler's method. 


e, = V(x, +h) - ty, +f yy} 
, h? n , 
= y, + hy (x,)4 z7 (x, +0h)- y, - hy (x,), 0«0«1 


2 
e, =E y", +0), 0<0<1 


Note: The Euler's method finds a sequence of values {y,} of y for the sequence of 
values 1x, j of x, step by step. But to get the solution up to a desired accuracy, we 
have to take the step size / to be very small. Again, the method should not be used 
for a larger range of x about x,, since the propagated error grows as integration 
proceeds. 


Example 1: Solve the following differential equation by Euler’s method for x — 0.1, 
d 
0.2, 0.3; taking h ^ 0.1; a - x? — y, y(0) =1. Compare the results with exact solu- 


tion. 


d 
Solution: Given =x? - y, with y (0) - 1. 
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In Euler's method one computes in successive steps, values of y,, y,, V3)... at 
x =x t h, x, — xy 2h, x, - x,* 3h, using the formula, 
Yna =Y, hf(x, y,), for n=0, 1, 2,.. 
Vast = y, th (Xn y) 


With h = 0.1 and starting with x, = 0, y, = 1, we present the successive 
computations in the table given below. 


RX, Yp  fGox)exXa», Yna = Yn A Oy Vo) 
0 0.0 1.000 —1.000 0.9000 
1 0.1 0.900 — 0.8900 0.8110 
2 0.2 0.8110 — 0.7710 0.7339 
3 0.3 0.7339 — 0.6439 0.6695 


The analytical solution ofthe differential equation written as a +y=x°, is 
X 
X Í 2 X 
ye -|x'e'dx-c 


Or, ye =x e" -2xe' + 2e* +c. 


Since, y=lforx=0,..c=-l. 


y-x -2x+2-e%. 


The following table compares the exact solution with the approximate solution 
by Euler’s method. 


n x, Approximate Solution Exact Solution % Error 
1 0. 0.9000 0.9052 0.57 
2. 0,2 0.8110 0.8213 1.25 
3 03 0.7339 0.7492 2.04 


Example 2: Compute the solution ofthe following initial value problem by Euler's 
method, for x = 0.1 correct to four decimal places, taking h = 0.02, 


d -x 
7 => * y(0-1, 
dx y+x 


Solution: Euler’s method for solving an initial value problem, 


d ; 
ET LOY) YO) = Vois y m y, HA f y, for n 20,2... 


Taking h = 0.02, we have x, = 0.02, x, = 0.04, x, = 0.06, x, — 0.08, x, — 0.1. 
Using Euler's method, we have, since y(0) = 1 


Euler's Method 


y(0.02) = y, 2 yy tA f (x9, Yo) 214 0.02x = = 1.0200 
y(0.04) = y, =y +h f(x,y) = 1.0200 + 0.02% 0-0 = 1.0392 
NOTES 
y(0.06) = y 2 y, +h f (x3, y3) = 1.0392 002x775 =1.0577 
y(0.08) = y, = y, +h f (x3, y3) = 1.0577 +0.02x- 0 = 1.0756 
(0.1) = y; 2 y, * h f (x4. y4) -10756- 002772555. 1,0928 


Hence, y (0.1) = 1.0928. 


Modified Euler's Method 


Inorderto get somewhat moderate accuracy, Euler's method is modified by computing 
the derivative y' = f (x, y), ata point x, as the mean of f (x „ y.) and fŒ y 9. ), 
where, 


yry, b f&n Yy,) 


h 11.4 
Vat y HS Cyt L Gane Oa 019 
This modified method is known as Euler-Cauchy method. The local truncation 
error of the modified Euler's method is ofthe order O(/?). 


Note: Modified Euler's method can be used to compute the solution up to a desired 
accuracy by applying it in an iterative scheme as stated below. 


Compute yna 2 y, th f(x,, Yn) 
h 
Compute ur" SV ii + 2 [Sn Y,a) + FG, ye. for k — 0, l, 23. (11.5) 


The iterations are continued until two successive approximations y“) and y 7^ 


n+l n+l 
coincide to the desired accuarcy. As a rule, the iterations converge rapidly for a 
sufficiently small A. If, however, after three or four iteration the iterations still do not 
give the necessary accuracy in the solution, the spacing / is decreased and iterations 
are performed again. 


Example 3: Use modified Euler’s method to compute y (0.02) for the initial value 


problem, 2 - x? +y, With y (0)= 1, taking A = 0.01. Compare the result with the 


X 
exact solution. 


Solution: Modified Euler's method consists of obtaining the solution at successive 
points, x, =x, +h, x, =x * 2h,..., x, —x,* nh, by the two stage computations given 
by, 


yo — Yn HAS Xn Yn) 


h 
X9 = y aros Ena] 
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Euler's Method For the given problem, f(x, y) ? x * y and h = 0.01 


y” =V + h[x; t yy] =14+0.01x1=1.01 


otho + 1.014 (0.01)?] 2 1.01005 


= 
el 


163 y,=y (0.01) «1.01005 


NOTES 


Next, yP =y +h[x? +y] 
= 1.01005 + 0.01[(0. 1)? +1.01005] 
= 1.01005+ 0.010102 = 1.02015 


0.01 
2 


A lx (2.02140) 


y? =1.01005 4 [(0.01)* + 1.01005 + (0.01)? +1.02015] 


=1.01005 + 


= 1.01005 +0.10107 
=1.11112 
“yy =y (0.02) =1.11112 


Euler’s Method for a Pair of Differential Equations 


Consider an initial value problem associated with a pair of first order differential 


equation given by, 


B= fos na, = g(x, y, 2) 


with y (xj) 7 y, z (x) = z, 


Euler's method can be extended to compute approximate values y, and z of y 


(x,) and z (x,) respectively given by, 
Xia =ythf x, Yp z) 
Za z+h S (x, Yp z) 


starting with i = 0 and continuing step by step for i= 1, 2, 3,... Evidently, we can also 
extend Euler's method for an initial value problem associated with a second order 


differential equation by rewriting it as a pair of first order equations. 
Consider the initial value problem, 


d^y _ dy ; ; 
E E , With y(x,) — y, y (xo) = Yo 


. d d ; 
We write = =z, so that re = g(x, y,z) with y (x,) =y, and z (x) = yo- 


d. 


Example 4: Compute y(1.1) and (1.2) by solving the initial value problem, 


[ 


y 


y ey -0 withy(1)70.77, y' (1) --0.44 
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Euler's Method 
. , , Z . 
Solution: We can rewrite the problem as y =z, z =-—- y; with y, (1) = 0.77 and 
p 7 X 


z (1.1) =-0.44. 
Taking h=0.1, we use Euler’s method for the problem in the form, NOTES 


Yu = Yit hz; 


Zi : 
zi = 2, th y; h 120,1, 2,... 
x 


i 


Thus, y, =y (1.1) and z, =z (1.1) are given by, 


y, = yg thzy = 0.77 + 0.1x (-0.44) = 0.726 


Xo 


= —0.44 - 0.33 = -0.473 


aca 30 n|- 0.44 +0.1x (0.44 — 0.77) 


Similarly, y, 7 (1.2) 2 y,*- hz, = 0.726 — 0.1 (-0.473) = 0.679 


z, =z(1.2)=z +h [-2-5,| 


x, 


= —0.473 + 0.1 x| L— 


= 0.726] 


= ~0.473 + 0.1x -0.296 = —0.503 
Thus, y (1.1)=0.726 and y (12)=0.679. 


Example 5: Using Euler’s method, compute y (0.1) and y (0.2) for the initial value 
problem, 
y"+y=0, y(0) - 0, y'(0) -1 
Solution: We rewrite the initial value problem as y' = z, z' = -y, with y (0) ^ 0, z (0) 
=], 
Taking A — 0.1, we have by Euler's method, 


y, = V0.1) = yo + hz, =0+0.1x1 =0.1 
z,=2(0.1l)=z,+h(-y,) =14+0.1x0 =1.0 
y, = V0.2) = y, + hz, =0.1+0.1x1.0 202 
z, =2(0.2) =z, —hy, =1.0-0.1x0.1 20.99 


Example 6: For the initial value problem y’+xy'+y=0, y(0) =0, y’(0) = 1. 
Compute the values of y for 0.05, 0.10, 0.15 and 0.20, having accuracy not exceeding 
0.5x10*. 

Solution: We form Taylor series expansion using y (0), y' (0) = 1 and from the 
differential equation, 
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y"  xy' * y = 0, we get y'(0) 20 
y"(x)-2-xy'-2y! ^ y"(0) = -2 
y(x)=-xy"-3y" sy") =0 
y" (x)= x? 4y" <. y"(0) =8 
And in general, y°”(0) 2 0, y@"*? (0) = 225,079 (0) = (-1)" 2.2! 


3 5 n n+l 
x x 2"n!x2 
x)2x—-—-4—-..4(-10'———— 
Thus, »() S RIS (=) Qn Dj 
This is an alternating series whose terms decrease. Using this, we form the 
solution for y up to 0.2 as given below: 


x 0 0.05 0.10 0.15 0.20 
y(x) 0 0.0500 0.0997 0.1489 0.1973 


Check Your Progress 


1. How are Euler's method and Taylor's method related? 


2. Why should we not use Euler's method for a larger range of x? 


11.5 ANSWERS TO CHECK YOUR PROGRESS 
QUESTIONS 


1. If we take k= 1, we get the Euler's method, y1 = yọ + h Axo, yo). 


2. The method should not be used for a larger range of x about xg, since the 
propagated error grows as integration proceeds. 


11.4 SUMMARY 


e Euler's isacrude but simple method of solving a first order initial value 
problem: 


d 
A fy), V(X) = Yo 


e The local error at any x, , i.e., the truncation error of the Euler’s method is 
given by, 


d E VO) Xia 
e Modified Euler's method can be used to compute the solution up to a desired 
accuracy by applying it in an iterative scheme as stated below. 


Compute y/9,, 2 y, +h f(x,, y,) 


h 
Compute y? = y, r [Fent Spars YO p for & 20,12... 


e Euler's method can be extended to compute approximate values y, and z, of 
y (xj) and z (x ) respectively given by, 


Vint =ythf x, Yp z) 
Zu F zh E (x, Yp z) 


11.5 KEY WORDS 


e Euler's method: The Euler’s method finds a sequence of values {y,} of y 
for the sequence of values (x, j of x, step by step. 


11.6 SELF ASSESSMENT QUESTIONS AND 
EXERCISES 


Short-Answer Questions 


1. Define Euler's method. 


2. Explain the Euler's method for a pair of differential equations. 
Long-Answer Questions 
1. Compute values of y at x — 0.02, by Euler's method taking A = 0.01, given 


yis the solution ofthe following initial value problem: 2 =x +y, y(0)=1. 


2. Evaluate y(0.02) by modified Euler ’s method, given y =x? * y, y(0)=1, 
correct to four decimal places. 
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TAYLOR'S METHOD, R.K METHOD 
AND STABILITY ANALYSIS 


UNIT 12 TAYLOR'S METHOD 


Structure 


12.0 Introduction 

12.1 Objectives 

12.2 Taylor's Method 

12.3 Answers to Check Your Progress Questions 
12.4 Summary 

12.5 Key Words 

12.6 Self Assessment Questions and Exercises 
12.7 Further Readings 


12.0 INTRODUCTION 


In mathematics, the Taylor series ofa function is an infinite sum ofterms that are 
expressed in terms ofthe function's derivatives at a single point. For most common 
functions, the function and the sum of its Taylor series are equal near this point. 
Taylor's series are named after Brook Taylor who introduced them in 1715. 


In this unit, you will study about the Taylor's method. 


12.1 OBJECTIVES 


After going through this unit, you will be able to: 
e Understand the Taylor's method 


e Explain the Taylor's series 


12.2 TAYLOR’S METHOD 


Consider the solution ofthe first order differential equation, 
e 
dx 


where f (x, y) is sufficiently differentiable with respect to x and y. The solution y (x) 
ofthe problem can be expanded about the point x, by a Taylor series in the form, 


= f(x,y) with y(x9) = yo (12.1) 


k k ! MH. 
y *b)e y (%) + hy’ (T y" oem ‘aap 022 


The derivatives in the above expansion can be determined as follows, Taylor's Method 


y (x9) = f G9. y9) 
Y" Qi) = f, Gg. yo) + f, Gg y) Y Gr) 
Y" G9) = Sa Qs Yo) + Wy G0 Yo) Y G8) f, Bos 9) D GO. + f, YH" Gs) NOTES 
where a suffix x or y denotes partial derivative with respect to x or y. 


Thus the value of y, = y (x, +h), can be computed by taking the Taylor series 
expansion shown above. Usually, because of difficulties in obtaining higher order 
derivatives, commonly a fourth order method is used. The solution at x, — x 7i, can 
be found by evaluating the derivatives at (x, y,) and using the expansion; otherwise, 
writing x, =x,+2h, we can use the same expansion. This process can be continued 
for determining y, ., with known values x , y „ 


Note: If we take k = 1, we get the Euler's method, y, =y,th f (x,, y,). 
Thus, Euler's method is a particular case of Taylor series method. 
Example 1: Form the Taylor series solution of the initial value problem, 


2 = xy +1, y(0) = 1 up to five terms and hence compute y (0.1) and y (0.2), correct 
X 


to four decimal places. 
Solution: We have, y'- xy «1, y(0) 21 
Differentiating successively we get, 
y"(x) = xy * y, y (0) =1 
y" (x) = xy" €2y', y" (0) 22 
y™ (x) = xy" «3y', MO) -3 
y9 (x) = xy 9 +3y", .y (0) = 6 


Hence, the Taylor series solution y (x) is given by, 


2 3 4 5 
" X n" x m x iv x v 
PORO Or Oa »"() «7» (0) O 


x? x? x4 x? x? x x4 x 
x 1+ x+—+—x24+—x3+ x6=1+x+—+—+—+ 
2 6 24 120 2 3 8 20 
; ; : i 1 
00s ee =1.1053 
2 3 8 20 


0.04 0.008 0.0016 0.00032 


iy (92) 2 3 8 20 


= 1.04274 


Example 2: Find first two non-vanishing terms in the Taylor series solution of the 
initial value problem y'= x? + y?, y(0) =0.Hence, compute y (0.1), y (0.2), y (0.3) 
and comment on the accuracy ofthe solution. 
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Taylor's Method Solution: We have, y! =x + y, y (0)=0 


Differentiating successively we have, 


NOTES y' 2 2x*2yy', z. y'(0) 20 
y" 2 242Dly" +, y"(0) =2 

y? = 2(yy" e 3y'y^, yO) 20 

yas p.i +4y'y"+3(y")"], ny en 

y = yy  5y'y 9? 10y"y"], y? 20 


yo) 2 [yy +6y'y (v) +15y"y (iv) +10(y")7] B y? (0) - 80 


3 7 7 
The Taylor seri is @)= x2 x ale 2 
e laylor series up to two terms 1s Y 6 4 7 3 63 


Example 3: Given x y' =x—y’, y(2) = 1, evaluate y(2.1), y(2.2) and y(2.3) correct 
to four decimal places using Taylor series method. 

Solution: Given y’ = x — y^,i.e., y -1— y^ / x and y =1 for x 22. To compute 
y(2.1) by Taylor series method, we first find the derivatives of y at x — 2. 


1 
yal-y'/x Ed c E 
xy' * y'21-2yy 
1 1 1 2 1 
2y"(2)+—=1-2.— = y"(2)=—-=x==-0.25 
y"(2) 2 5 y"(2) 21755 


xy" + 2y* - —2y” S 2yy" 


2y"(2)+2 3: (3) | J 


1 1 
2y"(2)=— eo y"(2)===0.25 
Or, y (2) 2 y"(2) 4 


3p 3y"- Ay'y" 2y'y" 2yy" 


1 1 1 1 
2y"*(2)-3x ——6x—x 2x 
OVER O B 4 


y"'Q) -[ LEES 5 --025 


(0. D E D 


y2D=y (2)*0.1 y'(2)*——— 


=1+0.1x0. sex 575) 20019 0000 


y'a € yma + yn) 


x(-0.25) 


=1+0.05 — 0.00125 + 0.00004 — 0.000001 
— 1.0488 
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0.008 x0254 0.0016 


.04 
y(2.2) =140.20.5+ =x (-0.25) + x(—0.5) 


— 14 0.1— 0.005 — 0.00032 — 0.00003 
= 1.0954 


.0081 
y(2.3) 214-0.3x 0.54- ES (-0.25) + E xd qute 


x (0.5) 


— 14 0.15— 0.01125 + 0.001125 + 0.000168 
= 1.005043 


Check Your Progress 
1. Explain the Taylor's method. 


2. Dive the derivative ofthe Taylor's series. 


12.3 ANSWERS TO CHECK YOUR PROGRESS 
QUESTIONS 


1. Consider the solution ofthe first order differential equation, 
dy 
dx 
2. The derivatives of Taylor's series can be determined as follows: 


= f(x,y) with y(xo) = yo 


y'(xg) = f Q yo) 
y" Qi) = f, Gt. y) t f£, XV) Y Gr) 


Y" (Xp) = Sa Eo Yo) + gy 0939) Y G9) + f, Gg. Vo" Oy) 5, WY" Qn) 


12.4 SUMMARY 


e The solution y (x) ofthe problem can be expanded about the point x, by a 

Taylor series in the form, 
k n 

y (x) h* + ( ia 
k! (k+1)! 

* because of difficulties in obtaining higher order derivatives, commonly a 
fourth order method is used. 

e The solution at x, =x, +h, can be found by evaluating the derivatives at 
(x, y,) and using the expansion; otherwise, writing x, =x,+2h, we can use 
the same expansion. 


, hr ” 
V(X +h) = y (x9) + hy tr y" Qs)... 


Taylor's Method 


NOTES 
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Taylor's Method 


12.5 KEY WORDS 


e Taylor's series method:If we take k= 1, we get the Euler’s method, y, = 


NOTES Yth f GS Vp): 
Thus, Euler’s method is a particular case of Taylor series method. 


12.6 SELF ASSESSMENT QUESTIONS AND 
EXERCISES 


Short-Answer Questions 


1. What is Taylor’s series? 


2. Give one example of Taylor’s method. 
Long-Answer Questions 


1. Discuss about the Taylor’s method. 


2. Compute the derivatives of Taylor’s expansion. 


12.7 FURTHER READINGS 
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Conte, Samuel D. and Carl de Boor. 1980. Elementary Numerical Analysis: 
An Algorithmic Approach. New York: McGraw-Hill. 
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UNIT 13 RUNGE KUTTA METHOD 


Structure NOTES 
13.0 Introduction 
13.1 Objectives 
13.2 Runge Kutta Method 
13.3 Answers to Check Your Progress Questions 
13.4 Summary 
13.5 Key Words 
13.6 Self Assessment Questions and Exercises 
13.7 Further Readings 


13.0 INTRODUCTION 


In numerical analysis, the Runge-Kutta methods are a family of implicit and explicit 
iterative methods, which include the well-known routine called the Euler Method, 
used in temporal discretization for the approximate solutions of ordinary differential 
equations. 


In this unit, you will study about the Runge-Kutta methods and Runge- 
Kutta methods for a pair of equations. 


13.1 OBJECTIVES 


After going through this unit, you will be able to: 
e Analyse the Runge-Kutta methods 


e Understand the Runge-Kutta methods for a pair of equations 


13.2 RUNGE KUTTA METHOD 


Runge-Kutta method can be of different orders. They are very useful when the 
method of Taylor series is not easy to apply because of the complexity of finding 
higher order derivatives. Runge-Kutta methods attempt to get better accuracy and 
at the same time obviate the need for computing higher order derivatives. These 
methods, however, require the evaluation of the first order derivatives at several 
off-step points. 


Here we consider the derivation of Runge-Kutta method of order 2. 
The solution of the (n + 1)th step is assumed in the form, 
Jn = yg ak. bk, (13.1) 
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Runge Kutta Method Where k, = h f (x, y,) and 
k, = h fx + ah, y + Bk,), for n — 0, 1, 2... (13.2) 


The unknown parameters a, b, œ, and B are determined by expanding in Taylor 
series and forming equations by equating coefficients of like powers ofA. We have, 
NOTES 
' he " he m 4 
Yaa = POPE, THY) ty Gn O) 


3 


2 
= y, HAS sr) e Ue rl +E aty ful f RA) (13.3) 


The subscript n indicates that the functions within brackets are to be evaluated 
at (x , y.). 
Again, expanding k, by Taylor series with two variables, we have 
; ?g? EC 
ke tah. S) +B). Go, abi, 0), «93 


Thus on substituting the expansion of k,, we get from Equation (13.4) 


(5,),*000)]. (13.4) 


Ya T Y,t(a*b)h f,*bh' (of,*Bff)), * bir [Ss coti, «B, eon 


On comparing with the expansion of y. _ and equating coefficients ofh and /? 


we get the relations, 


n+l 


a+b=1, bo. = 5B = + 


There are three equations for the determination of four unknown parameters. 
Thus, there are many solutions. However, usually a symmetric solution is taken by 


setting a=b=>, then a=B=1 
Thus we can write a Runge-Kutta method of order 2 in the form, 
h 
Ja = Yn Fy LS On Ya) + f(x, +h, y, th f, Y, for n — 0, l, 25i (13.5) 


Proceeding as in second order method, Runge-Kutta method of order 4 can be 
formulated. Omitting the derivation, we give below the commonly used Runge- 
Kutta method of order 4. 


YEY, +k + 2k, +2k, +k,)+0(A°) 


k -h f(x, y,) 
h k 
E +—, y, +— 
2 (s 2 Vn 3 
h k 
kh +—, y +2 
3 (s 2 Yn 2| 
k,— hf (x, +h, y, tk) (13.6) 
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Runge-Kutta method oforder 4 requires the evaluation ofthe first order derivative Runge Kutta Method 
f (x, y), at four points. The method is self-starting. The error estimate with this 
method can be roughly given by, 


b (x,) -yJe (3/7)| ^ NOTES 


where y, and y, are the approximate values computed with 3 and h respectively 
as step size and y (x_) is the exact solution. 


Note: In particular, for the special form of differential equation y'= F(x), a function 
of x alone, the Runge-Kutta method reduces to the Simpson's one-third formula of 
numerical integration from x, tox, ,,. Then, 


MATT 
h h 
Os Yau my tg FG) + 4F AS) + Ft] 


Runge-Kutta methods are widely used particularly for finding starting values at 
steps x, X, x.,..., Since it does not require evaluation of higher order derivatives. It 
is also easy to implement the method in a computer program. 


Example 1: Compute values ofy (0.1) and y (0.2) by 4th order Runge-Kutta method, 
correct to five significant figures for the initial value problem, 


® = x+y, 0)=1 
dx 


d 
Solution: We have = =x+y, (0) =1 


f(x yy=xty,  hz0. x, =0, y, =1 
By Runge-Kutta method, 


1 
y(0.D=y(0) +z (k +2k, + 2k, +k4) 


where, k =h f(x} ya)=0.1x(0+1)=0.1 
k 
k =h ES y+ 42) =0.1% (0.05 105) - 01 


k 
k,=h (s e D +2}. 0.1 (0.05 + 1.055) = 0.1105 


k, 2h f(x +h, vo +k) = 0.1% (0.1 41.1105) = 0.12105 
where 1 
5 VOD=14— [0.1+2x(0.11+0.1105+0.12105]=1.130516 


Thus, x, 20.1, y, 21.130516 
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Runge Kutta Method 1 
y (0.2) = y(0.1) + 5 (k, * 2k, +2k, +k,) 


k 2h f(x, y,)=0.1x(0.1+1.11034) = 0.121034 


k,-h it +S y, +4)-= 0.1 (0.15 +1.17086) = 0.132086 


NOTES 
h k, 
k, =h f| +>, 7 + |=0.1 0.15 +1.17638) = 0.132638 
k, =h f(x, +h, y, +k,)=0.1 (0.2 +1.24298) = 0.144298 
y, =y (0.2) = 1.110344 [0.121034 + 2 (0.132086 + 0.132638) + 0.144298] = 1.2428 


Example 2: Use Runge-Kutta method of order 4 to evaluate y (1.1) and y (1.2), by 
taking step length A — 0.1 for the initial value problem, 


& Là «y^, y()-0 
dx 
Solution: For the initial value problem, 
dy Le a 
K = f(x, y), y (x) = Yə the Runge-Kutta method of order 4 is given as, 
x 
1 
Yn — Yn TOUR 2k, -2k, tk) 
k = h fX, Ya) 
h k 
k, =h +>, y, +> 
2 f. 2 Yn 2 ) 
2 
Were oh vm 


k, 2 h f (x, +h, y, +k), for n 20,1, 2,... 


For the given problem, f(x, y) 2 x^ * y^, x, = 1, y, 70, A — 0.1. 
Thus, 


k 2h f(x, Y) 20.1x (P +0?) 20.1 


k 
k, ZEE e «5 jeorxttos! +(0.5)?] 2 0.13525 


k 
k =h zs +y, +2). 0.1 x[(1.05) + (0.05525)^] = 0.13555 


k, =h f (x, +h, y, k,) =0.1x[(1.1)? + (0.13555)^] = 0.12283 
nA "x (k, 2k, +2k, +k,) 
=~ (0.14 0.2705 +0.2711 + 0.12283) = 2x 0.76443 
= 0.127405 


Self-Instructional 
316 Material 


Fory (1 2): Runge Kutta Method 


k, 20.1 
k, 20.1 
k, 20.1 
,=0.1 


(1.1? + (0.11072) ] = 0.12226 

(1.15)? + (0.17183) ] = 0.135203 
(1.15? + (0.17832)°] = 0.135430 
(1.2)? + (0.24615)^] = 0.150059. 


NOTES 


“~ y, =y (1.2) =0.11072 + : (0.12226 + 0.270406 + 0.270860 + 0.150069) 
= 0.24631 


Algorithm: Solution of first order differential equation by Runge-Kutta method of 
order 2: y'= f(x) with y (x) = y,. 

Step 1: Define f (x, y) 

Step 2: Read x,, Yy A, x , [A is step size, x is final x] 

Step 3: Repeat Steps 4 to 11 until x, >x, 

Step 4: Compute k, =f (x, Yo) 

Step 5: Compute y, = y,* hk, 

Step 6: Compute x, — x, h 

Step 7: Compute k, =f (x,, y,) 

Step 8: Compute y, = yg +hx(k, - k5)/2 

Step 9: Write x,, y, 

Step 10: Set x, — x, 

Step 11: Set y, — y, 

Step 12: Stop 
Algorithm: Solution of y, 2 f(x, y), y(%))=y by Runge-Kutta method of 
order 4. 

Step 1: Define f (x, y) 

Step 2: Read x,, Yy A, x, 

Step 3: Repeat Step 4 to Step 16 until x, >x ? 

Step 4: Compute k, = h f (x, y,) 


Step 5: Compute x = x, +t 
Step 6: Compute y = yo -A 
Step 7: Compute k, = A f(x, y) 
Step 8: Compute y = yo 2 
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Step 9: Compute k, = A f(x, y) 

Step 10: Compute x, 2 xy- A 

Step 11: Compute y = y,* k, 

Step 12: Compute k, = h f (x,, y) 

Step 13: Compute y, = y,* (k+ 2 (k+ k,) + k,)/6 
Step 14: Write x,, y, 

Step 15: Set x, — x, 

Step 16: Set y, — y, 

Step 17: Stop 


Runge-Kutta Method for a Pair of Equations 
Consider an initial value problem associated with a system of two first order ordinary 
differential equations in the form, 


dy _ dz _ 
a: 4 P895 ER d. 8082) 


with | y(x,) 2 y», and z(x,) = Zo 


The Runge-Kutta method of order 4 can be easily extended in the following 
form, 


1 
Xia = i ta (ki 2k, * 2k, + k4) 


1 13.8 
quce (L +21, - 2L +L) for i 2 0,1, 2,... S 
Where k, = hf (x; Yp z;). l 2 hg(x,, yj, z;) 
h k l h k I 
ks M (ssl) hs psa] 
h k l h k l 
hm) EE 


k,-hf(x, th yp zh) — L-hfG +h, y, +hyz, +h) 


Yi = y(x;), Zi = z(x;), i- 0, l, p 
The solutions for y(x) and z(x) are determined at successive step points x, =x, th, x, 
—X th = xt2h,..., xy = x NA. 
Runge-Kutta Method for a Second Order Differential Equation 


Consider the initial value problem associated with a second order differential equation, 
2 


d , 
t = g(x, y, y) 
dx 


with y (x,) =y, and y' (x,) ^ € 


On substituting z = y’, the above problem is reduced to the problem, 


dy dz _ 
dx =Z, 3; "805 Y, z) 
with y (x,) =y, and z (x,) = »' (x) = o 


which is an initial value problem associated with a system oftwo first order differential 
equations. Thus we can write the Runge-Kutta method for a second order differential 
equation as, 


Jia 5 Yi -i (ki 2k, +2k, +k,), 


, 1 ; (13.9) 
Za ^ Vie =; E (/, + 21, + 21, +1,) for i 2 0,1, 2,... 


where k, =h(z,), L=hg(x,, y; z) 


l h k l 
k =h|z,+4|, L=hg|x, , y+, z+ 
2 (z i) 2 (s J; 2 i 3 


2 2 
l h k l 
k, -hiz4—|, L-hg|x, ) Y , Z4 
3 (s 3 3 E 2 Ji 2 i 3 


k =h(z +L), L=hg(x +h, y,+k, zh) 


N 


Check Your Progress 


1. When are Runge-Kutta methods applied? 
2. Give the uses of Runge-Kutta method. 


13.3 ANSWERS TO CHECK YOUR PROGRESS 
QUESTIONS 


1. Runge-Kutta methods are very useful when the method of Taylor series is 
not easy to apply because of the complexity of finding higher order 
derivatives. 


2. Runge-Kutta methods are widely used particularly for finding starting values 
at steps XX X ses since it does not require evaluation of higher order 
derivatives. It is also easy to implement the method in a computer program. 


13.4 SUMMARY 


è Runge-Kutta methods attempt to get better accuracy and at the same time 
obviate the need for computing higher order derivatives. 


Runge Kutta Method 


NOTES 
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Runge Kutta Method e The solution ofthe (n + 1)th step is assumed in the form, 
Xia B we ak bk, 
Where k, =h f (x,, y.) and k, = h f(x + oui, y+ Bk), for n = 0, 1, 2,... 


NOTES e Runge-Kutta method of order 4 requires the evaluation of the first order 
derivative f (x, y), at four points. The method is self-starting. 


e In particular, for the special form of differential equation y’ = F(x), a function 
ofx alone, the Runge-Kutta method reduces to the Simpson's one-third formula 
of numerical integration from x, to x 


e The Runge-Kutta method of order 4 can be easily extended in the following 
form, 


Jia = Yi x (ki + 2k, * 2k, +k,) 


1 
Za =Z; M (L +21, +21, +L) for i 2 0,1, 2,... 


13.5 KEY WORDS 


e Runge-Kutta Method It can be of different orders. They are very useful 
when the method of Taylor series is not easy to apply because ofthe complexity 
of finding higher order derivatives. 


13.6 SELF ASSESSMENT QUESTIONS AND 
EXERCISES 


Short-Answer Questions 


1. Whatis thesignificance of Runge-Kutta methods of different orders? 
2. Explain the Runge-Kutta method for a pair of equations. 


Long-Answer Questions 


1. Using Runge-Kutta method of order 4, compute y(0.1) for each of the 
following problems: 


d 
(a) “= x+y, 9-1 
dx 


() £ -xey y9)-1 


2. Compute solution ofthe following initial value problem by Runge-Kutta 
method of order 4 taking / = 0.2 upto x = 1; y 2x — y, (0) = 1.5. 
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UNIT 14 STABILITY ANALYSIS 


Structure 
14.0 Introduction 
14.1 Objectives 
14.2. Stability Analysis 
14.3 Answers to Check Your Progress Questions 
14.4 Summary 
14.5 Key Words 
14.6 Self Assessment Questions and Exercises 
14.7 Further Readings 


14.0 INTRODUCTION 


In mathematics, stability theory addresses the stability of solutions of differential 
equations and of trajectories of dynamical systems under small perturbations of 
initial conditions. The heat equation, for example, is a stable partial differential 
equation because small perturbations of initial data lead to small variations in 
temperature at a later time as a result ofthe maximum principle. In partial differential 
equations one may measure the distances between functions using Lp norms or 
the sup norm, while in differential geometry one may measure the distance between 
spaces using the Gromov-Hausdorff distance. 


In this unit, you will study about stability analysis. 


14.1 OBJECTIVES 


After going through this unit, you will be able to: 
e Explain the basic concept of stability analysis 


e Understand the use of stability concept in finding solutions 


14.2 STABILITY ANALYSIS 


In mathematics and statistics stability theory defines the stability of solutions 
of differential equations and of trajectories of dynamical systems under small 
perturbations of initial conditions. The heat equation, for example, is a stable partial 
differential equation because small perturbations of initial data lead to small variations 
in temperature at a later time as a result of the maximum principle. In partial 
differential equations one may measure the distances between functions using Lp 
norms or the sup norm, while in differential geometry one may measure the distance 
between spaces using the Gromov-Hausdorff distance. 


Under favourable circumstances, the question may be reduced to a well- 
studied problem involving eigenvalues of matrices. A more general method 
involves Lyapunov functions. In practice, any one ofa number of different stability 
criteria are applied. 


Overview in Dynamical Systems 


Many parts ofthe qualitative theory of differential equations and dynamical systems 
deal with asymptotic properties of solutions and the trajectories—what happens 
with the system after a long period of time. The simplest kind of behaviour is 
exhibited by equilibrium points, or fixed points, and by periodic orbits. Ifa particular 
orbit is well understood, it is natural to ask next whether a small change in the initial 
condition will lead to similar behaviour. Stability theory helps us to find that whether 
a nearby orbit will indefinitely stay close to a given orbit ,or will it converge to a 
given orbit. In the former case, the orbit is called stable; in the latter case, it 1s 
called asymptotically stable and the given orbit is said to be attracting. 
An equilibrium solution f. to an autonomous system of first order ordinary 
differential equations is called: 
e Stable if for every (small) £ >0 , there exists a 020 ,such that every 
solution f(t) having initial conditions within distance 6 ,i.e. , 
| At,)-f, || «9 ofthe equilibrium remains within distance e, i.e. , for 
all ||f(?) -f.|| «€ forallt 2 £, 
e Asymptotically stable if it is stable and, in addition, there exists 0,7 0 , 
such that whenever || At) - f; || 9, then KA f. as toe. 


Poincaré Diagram: Classification of Phase Portaits in the (det A, Tr A)-plane 


A=0: 
let A 2 
A=0 - det A=1(Tr A)? 


spiral source 
degenerate source 


| 


center 


ee 


degenerate sink 


line of stable fixed points saddle line of unstable fixed points 
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Stability Analysis Stability means that the trajectories do not change too much under small 
perturbations. The opposite situation, where a nearby orbit is getting repelled 
from the given orbit. In general, perturbing the initial state in some directions results 
in the trajectory asymptotically approaching the given one and in other directions 

NOTES to the trajectory getting away from it. There may also be directions for which the 
behaviour of the perturbed orbit is more complicated (neither converging nor 
escaping completely), and then stability theory does not give sufficient information 
about the dynamics. 


In stability theory, the qualitative behaviour of an orbit under perturbations 
can be analysed using the linearization ofthe system near the orbit. In particular, at 
each equilibrium ofa smooth dynamical system with an n-dimensional phase space, 
there is a certain nxn matrix A whose eigenvalues characterize the behaviour of 
the nearby points (Hartman-Grobman theorem). More precisely, if all eigenvalues 
are negative real numbers or complex numbers with negative real parts then the 
point is a stable attracting fixed point, and the nearby points converge to it at 
an exponential rate, Lyapunov stability and exponential stability. If none ofthe 
eigenvalues are purely imaginary (or zero) then the attracting and repelling directions 
are related to the eigen-spaces of the matrix A with eigenvalues whose real part is 
negative and, respectively, positive. Analogous statements are known for 
perturbations of more complicated orbits. 


Stability of Fixed Points 


The simplest kind of an orbit is a fixed point, or an equilibrium. If a mechanical 
system is in a stable equilibrium state then a small push will result in a localized 
motion, for example, small oscillations as in the case of a pendulum. In a system 
with damping, a stable equilibrium state is moreover asymptotically stable. On the 
other hand, for an unstable equilibrium, such as a ball resting on a top ofa hill, 
certain small pushes will result in a motion with a large amplitude that may or may 
not converge to the original state. Stability of a nonlinear system can be deduced 
from the stability of its linearization. 


Maps: Let f: R  R bea continuously differentiable function with a fixed 
point a, f(a) = a. Consider the dynamical system obtained by iterating the function f: 

Kae ee n=0,1,2,.... 

The fixed point & is stable if the absolute value of the derivative of f at o 


is strictly less than 1, and unstable if it is strictly greater than 1. This is because near 
the point a, the function fhas a linear approximation with slope f(a): 


Ax) = fla) + f (a) — a). 
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Thus Stability Analysis 


, Xi 7 Xn , 
-(£'(4)-J(s, - a) = f'(a)-1 NOTES 
which means that the derivative measures the rate at which the successive 
iterates approach the fixed point a or diverge from it. If the derivative at a is 
exactly 1 or “1, then more information is needed in order to decide stability. 


There is an analogous criterion for a continuously differentiable 
map f: R” > R” with a fixed point a, expressed in terms of its Jacobian 
matrix at a, J (f). Ifall eigenvalues of J are real or complex numbers with absolute 
value strictly less than 1 then a is a stable fixed point; ifat least one of them has 
absolute value strictly greater than 1 then a is unstable. Just as for n=1, the case of 
the largest absolute value being | needs to be investigated further — the Jacobian 
matrix test is inconclusive. The same criterion holds more generally 
for diffeomorphisms ofa smooth manifold. 


Linear Autonomous Systems 


The stability of fixed points ofa system of constant coefficient linear differential 
equations of first order can be analysed using the eigenvalues of the corresponding 
matrix. 

An autonomous system 

x’ = Ax, 


where x(t) e R” and A is an nxn matrix with real entries, has a constant 
solution 

x(t) = 0. 

(In a different language, the origin 0 € R” is an equilibrium point of the 
corresponding dynamical system.) This solution is asymptotically stable as fee 
(“in the future”) iff for all eigenvalues À of A, Re(4) « 0. Similarly, it is asymptotically 
stable as t + —ee (“in the past") iff for all eigenvalues A4 of A, Re(A) > 0. If there 
exists an eigenvalue 4 of A with Re(A) 7 0 then the solution is unstable for £ °! **. 


The stability of the origin for a linear system can be determined by the Routh- 
Hurwitz stability criterion. The eigenvalues of a matrix are the roots of 
its characteristic polynomial. A polynomial in one variable with real coefficients is 
called a Hurwitz polynomial ifthe real parts of all roots are strictly negative. 
The Routh-Hurwitz theorem implies a characterization of Hurwitz polynomials by 
means ofan algorithm that avoids computing the roots. 


Non-Linear Autonomous Systems 


Asymptotic stability of fixed points ofa non-linear system can be demonstrated 


using the Hartman-Grobman theorem. 
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Suppose that v is a C'-vector field in R" which vanishes at a point p, 
v(p) = 0. Then the corresponding autonomous system 

x’ = v(x) 

has a constant solution 

x(t) = p. 

Let J (v) be the nxn Jacobian matrix of the vector field v at the point p. If 


p 
all eigenvalues of J have strictly negative real part then the solution is asymptotically 
stable. This condition can be tested using the Routh-Hurwitz criterion. 


Check Your Progress 


1. How can linear differential equations of first order be analysed? 


2. Define Hurwitz polynomial. 


3. How can asymptotic stability of fixed points be demonstrated? 


14.3 ANSWERS TO CHECK YOUR PROGRESS 
QUESTIONS 


1. The stability of fixed points of a system of constant coefficient linear 
differential equations of first order can be analysed using the eigenvalues of 
the corresponding matrix. 

2. A polynomial in one variable with real coefficients is called a Hurwitz 
polynomial ifthe real parts ofall roots are strictly negative. 


3. Asymptotic stability of fixed points of a non-linear system can be 
demonstrated using the Hartman-Grobman theorem. 


14.4 SUMMARY 


e The simplest kind of behaviour is exhibited by equilibrium points, or fixed 
points, and by periodic orbits. 


e Stability theory helps us to find that whether a nearby orbit will indefinitely 
stay close to a given orbit ,or will it converge to a given orbit. In the former 
case, the orbit is called stable; in the latter case, it is called asymptotically 
stable and the given orbit is said to be attracting. 


e Stability means that the trajectories do not change too much under small 
perturbations. 


e Instability theory, the qualitative behaviour of an orbit under perturbations 
can be analysed using the linearization of the system near the orbit. 


e [fall eigenvalues are negative real numbers or complex numbers with 
negative real parts then the point is a stable attracting fixed point, and the 
nearby points converge to it at an exponential rate, Lyapunov stability and 
exponential stability. 


The simplest kind ofan orbit is a fixed point, or an equilibrium. 


Stability of a nonlinear system can be deduced from the stability of 
its linearization. 


The fixed point o is stable if the absolute value ofthe derivative of f at o 
is strictly less than 1, and unstable if it is strictly greater than 1. 


There is an analogous criterion for a continuously differentiable 
map f: R” > R” with a fixed point a, expressed in terms of its Jacobian 
matrix at a, J (f). 


The stability ofthe origin for a linear system can be determined by the Routh- 
Hurwitz stability criterion. 


e The Routh-Hurwitz theorem implies a characterization of Hurwitz 
polynomials by means ofan algorithm that avoids computing the roots. 


Ifall eigenvalues of J have strictly negative real part then the solution is 
asymptotically stable. 


14.5 KEY WORDS 


e Maps: Let f: R  R bea continuously differentiable function with a fixed 
point a, f(a) = a. Consider the dynamical system obtained by iterating the 
function f: 


No a fæ) n=0,1,2,.... 


14.6 SELF ASSESSMENT QUESTIONS AND 
EXERCISES 


Short-Answer Questions 

1. Define stability. 

2. Elaborate on non-linear autonomous systems. 
Long-Answer Questions 


1. Explain the stability theory. 


2. Give details on linear autonomous systems. 
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